[ 532.504179] env[65367]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 532.504179] env[65367]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 533.484088] env[65455]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 533.484088] env[65455]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 535.295633] env[65455]: INFO neutron.common.config [-] Logging enabled! [ 535.296084] env[65455]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev88 [ 535.296160] env[65455]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65455) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 535.296460] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 535.296554] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 535.297382] env[65455]: WARNING oslo_policy.policy [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.297595] env[65455]: WARNING oslo_policy.policy [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 535.299247] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] VMware NSXv3 Agent initialized successfully. [ 535.299597] env[65455]: DEBUG oslo_concurrency.lockutils [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Acquiring lock "singleton_lock" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.299724] env[65455]: DEBUG oslo_concurrency.lockutils [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Acquired lock "singleton_lock" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.299950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Releasing lock "singleton_lock" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.300241] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Full set of CONF: {{(pid=65455) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 535.300352] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ******************************************************************************** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 535.300454] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Configuration options gathered from: {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 535.301042] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 535.301223] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 535.301332] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ================================================================================ {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 535.301495] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] agent_down_time = 75 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.301636] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] allow_automatic_dhcp_failover = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.301769] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] allow_bulk = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.301942] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] api_extensions_path = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302112] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] api_paste_config = api-paste.ini {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302253] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] auth_strategy = keystone {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302356] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] backdoor_port = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302455] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] backdoor_socket = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302586] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] backlog = 4096 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302718] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] base_mac = fa:16:3e:00:00:00 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.302873] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] bind_host = 0.0.0.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303017] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] bind_port = 9696 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303153] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] client_socket_timeout = 900 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303284] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] config_dir = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303388] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303519] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] config_source = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303653] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] control_exchange = neutron {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303787] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] core_plugin = ml2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.303921] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] debug = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304063] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] default_availability_zones = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304265] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304400] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dhcp_agent_notification = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304529] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dhcp_agents_per_network = 1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304657] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dhcp_lease_duration = 86400 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304793] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dhcp_load_type = networks {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.304926] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dns_domain = openstacklocal {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305067] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305198] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_default_route_bfd = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305557] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_default_route_ecmp = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305557] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_dvr = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305679] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_new_agents = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305763] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.305975] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_signals = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.306201] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] enable_traditional_dhcp = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.306400] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] external_dns_driver = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.306615] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] filter_validation = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.306850] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] global_physnet_mtu = 8950 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.307094] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] graceful_shutdown_timeout = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.307376] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] host = cpu-1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.307606] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] host_dvr_for_dhcp = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.307841] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] http_retries = 3 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308075] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] instance_format = [instance: %(uuid)s] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308258] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308405] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ipam_driver = internal {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308541] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ipv6_pd_enabled = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308673] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] l3_ha = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308842] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.308981] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] l3_ha_network_physical_name = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309132] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] l3_ha_network_type = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309274] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_color = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309409] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_config_append = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309553] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309680] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_dir = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309810] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_file = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.309914] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_options = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310056] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_rotate_interval = 1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310196] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_rotate_interval_type = days {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310332] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] log_rotation_type = none {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310436] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310536] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310674] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310809] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.310910] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311050] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_dns_nameservers = 5 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311204] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_header_line = 16384 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311338] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_l3_agents_per_router = 3 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311465] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_logfile_count = 30 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311592] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_logfile_size_mb = 200 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311719] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] max_subnet_host_routes = 20 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311855] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] my_ip = 10.180.1.21 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.311988] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] my_ipv6 = ::1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312132] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] network_auto_schedule = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312256] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] network_link_prefix = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312395] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312534] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] notify_nova_on_port_data_changes = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312668] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] notify_nova_on_port_status_changes = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312801] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] pagination_max_limit = -1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.312929] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] publish_errors = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313067] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rate_limit_burst = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313202] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rate_limit_except_level = CRITICAL {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313328] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rate_limit_interval = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313454] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] retry_until_window = 30 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313580] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] router_distributed = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313707] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rpc_resources_processing_step = 20 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313833] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rpc_response_max_timeout = 600 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.313973] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] rpc_response_timeout = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314114] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] send_events_interval = 2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314262] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] service_plugins = ['router'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314400] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] setproctitle = on {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314528] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] shell_completion = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314661] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] state_path = /opt/stack/data/neutron {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314796] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] syslog_log_facility = LOG_USER {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.314926] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] tcp_keepidle = 600 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315071] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] transport_url = **** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315203] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] use_journal = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315331] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] use_json = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315460] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] use_ssl = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315585] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] use_stderr = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315718] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] use_syslog = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315844] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vlan_qinq = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.315970] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vlan_transparent = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316106] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] watch_log_file = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316235] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] wsgi_default_pool_size = 100 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316362] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] wsgi_keep_alive = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316495] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316620] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] wsgi_server_debug = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 535.316763] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_concurrency.disable_process_locking = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.316904] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317052] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317186] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317324] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317460] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317591] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317738] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.connection_string = messaging:// {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.317876] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.enabled = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318030] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.es_doc_type = notification {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318158] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.es_scroll_size = 10000 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318297] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.es_scroll_time = 2m {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318431] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.filter_error_trace = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318566] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.hmac_keys = **** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318705] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.sentinel_service_name = mymaster {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.318875] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.socket_timeout = 0.1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319028] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.trace_requests = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319166] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler.trace_sqlalchemy = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319314] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler_jaeger.process_tags = {} {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319446] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler_jaeger.service_name_prefix = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319578] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] profiler_otlp.service_name_prefix = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319723] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.enforce_new_defaults = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.319985] env[65455]: WARNING oslo_config.cfg [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 535.320146] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.enforce_scope = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320287] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.policy_default_rule = default {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320434] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320574] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320714] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320844] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.320975] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321139] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321282] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321418] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_policy.remote_timeout = 60.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321565] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321709] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] agent.extensions = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321845] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.321981] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] service_providers.service_provider = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322133] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.default_quota = -1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322271] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322403] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_floatingip = 50 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322533] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_network = 100 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322663] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_port = 500 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322790] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.322917] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_router = 10 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323057] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_security_group = 10 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323192] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323323] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.quota_subnet = 100 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323454] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] QUOTAS.track_quota_usage = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323600] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323731] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323862] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.323994] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324141] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324273] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324402] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324539] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324667] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324793] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.324922] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325066] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325197] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325322] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_dhcp_release.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325458] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325584] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325709] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325836] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.325970] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326111] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326241] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_ovs_vsctl.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326382] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.capabilities = [21] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326509] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326636] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326766] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.326904] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327043] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327175] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_namespace.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327334] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.capabilities = [12] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327465] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327593] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327721] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327854] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.327983] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328123] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_conntrack.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328260] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.capabilities = [12, 21] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328386] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.group = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328510] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.helper_command = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328638] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.log_daemon_traceback = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328801] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.328936] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.thread_pool_size = 8 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329075] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] privsep_link.user = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329225] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329370] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329506] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.continue_on_failed_promotions = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329637] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.dscp = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329783] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.dscp_inherit = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.329934] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.force_mp_to_policy = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330082] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.locking_coordinator_url = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330220] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.log_agent_heartbeats = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330355] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.logging_expire = 1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330497] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330631] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330773] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.polling_interval = 240 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.330907] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331056] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331212] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.report_interval = 30.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331357] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331500] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331642] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331780] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.sync_skew = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.331917] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.synchronization_queue_size = 20 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332061] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT.use_helper_for_ns_read = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332203] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] SECURITYGROUP.enable_ipset = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332343] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] SECURITYGROUP.enable_security_group = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332484] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332625] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332763] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] experimental.ipv6_pd_enabled = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.332920] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.extension_drivers = ['port_security'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333064] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.external_network_type = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333214] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333353] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.overlay_ip_version = 4 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333490] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.path_mtu = 8950 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333626] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.physical_network_mtus = {} {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333767] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.tenant_network_types = ['vlan'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.333908] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334061] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ml2.type_drivers = ['vlan'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334205] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT_CLI.neutron_port_id = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334337] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334469] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334609] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334750] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.334886] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335034] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335177] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335314] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335507] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335654] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_login_password = **** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335794] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_login_port = 443 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.335934] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_login_user = admin {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336081] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336225] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336359] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336490] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336629] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336773] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.336911] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337058] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337195] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337333] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337473] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337607] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337744] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.337933] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338091] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vsphere.vsphere_login_password = VMware1! {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338233] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338368] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338507] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.auth_section = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338649] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.auth_type = password {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338805] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.338952] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.certfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339104] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.collect_timing = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339250] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.endpoint_type = public {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339387] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.insecure = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339519] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.keyfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339659] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.region_name = RegionOne {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.339820] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.split_loggers = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340048] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] nova.timeout = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340219] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.auth_section = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340367] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.auth_type = password {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340509] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340641] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.certfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340776] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.collect_timing = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.340919] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.endpoint_type = public {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341065] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.insecure = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341223] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.keyfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341356] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.region_name = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341490] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.split_loggers = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341617] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] placement.timeout = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341756] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.auth_section = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.341891] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.auth_type = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342032] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.cafile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342165] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.certfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342296] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.collect_timing = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342424] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.connect_retries = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342552] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.connect_retry_delay = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342682] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.enable_notifications = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342807] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.endpoint_override = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.342936] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.insecure = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343075] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.interface = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343205] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.keyfile = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343338] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.max_version = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343465] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.min_version = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343590] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.region_name = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343717] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.retriable_status_codes = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343844] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.service_name = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.343971] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.service_type = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344111] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.split_loggers = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344237] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.status_code_retries = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344364] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.status_code_retry_delay = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344490] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.timeout = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344616] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.valid_interfaces = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344742] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ironic.version = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.344878] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] cli_script.dry_run = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345031] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345169] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345300] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345430] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345558] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345687] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345816] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.345948] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346086] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346225] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346353] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346492] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346629] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346767] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.346900] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347052] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347190] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347321] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347459] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347596] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347729] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347860] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.347990] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348132] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348262] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348392] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348520] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348648] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348827] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.348993] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349100] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349240] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349376] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349508] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349643] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349795] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.ssl_version = {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.349943] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.350102] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_notifications.driver = [] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.350236] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_notifications.retry = -1 {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.350383] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.350515] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] oslo_messaging_notifications.transport_url = **** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 535.350620] env[65455]: DEBUG oslo_service.backend._eventlet.service [None req-26cc2157-f68c-4136-9511-447fd56f234c None None] ******************************************************************************** {{(pid=65455) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 535.351766] env[65455]: DEBUG neutron.agent.securitygroups_rpc [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Init firewall settings (driver=nsxv3) {{(pid=65455) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 535.353086] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65455) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 535.353319] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] RPC agent_id: nsxm-l-01a.corp.local [ 535.355514] env[65455]: DEBUG dogpile.cache.region [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.355640] env[65455]: DEBUG dogpile.lock [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 535.355735] env[65455]: DEBUG dogpile.lock [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 535.355823] env[65455]: DEBUG dogpile.lock [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 535.355915] env[65455]: DEBUG dogpile.cache.region [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 535.356007] env[65455]: DEBUG dogpile.lock [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 535.356132] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 535.374816] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Session token - acquiring [ 535.376326] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.376490] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.376615] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.376987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.387111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.690886] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 535.717600] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 535.717931] env[65455]: DEBUG dogpile.cache.region [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Cache value generated in 0.362 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 535.718098] env[65455]: DEBUG dogpile.lock [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 535.718231] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Activating Policy API Provider. [ 535.718429] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Looking for the default Infrastructure Rules. [ 535.796487] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Looking for the Default Layer3 Logged Drop Section. [ 535.813092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 535.814051] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.814051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.814235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.814371] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.815444] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.331463] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 536.834499] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.335810] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Inventory metadata is going to be refreshed. [ 537.336245] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 538.095650] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.095921] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.095970] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.096307] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.107391] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 538.108293] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.109242] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 538.126157] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.126361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.126428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.126768] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.126892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.127052] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 538.127167] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.127269] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 538.147809] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.148052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.148180] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.148510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.148774] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.148953] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 538.168731] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.168916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.169029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.169326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.169476] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.169621] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 538.191968] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.192242] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.192434] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.192743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.192890] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.193057] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 538.193163] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.193264] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 538.215014] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.215268] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.215319] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.215627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.215754] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.215901] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 538.216014] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.216124] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 538.237794] env[65455]: DEBUG networking_nsxv3.common.locking [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.238063] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.238120] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.238399] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.238571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.238769] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 538.238879] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 538.238976] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Inventory metadata have been refreshed. [ 538.239085] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Dryrun:True. Metadata refresh completed. [ 538.239224] env[65455]: DEBUG oslo_concurrency.lockutils [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Releasing lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.240924] env[65455]: INFO neutron.agent.agent_extensions_manager [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Loaded agent extensions: [] [ 538.241711] env[65455]: DEBUG neutron_lib.callbacks.manager [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65455) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 538.301794] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent RPC Daemon Started! [ 538.302015] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:0 started [ 538.302070] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent out of sync with plugin! [ 543.242609] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 543.243104] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.244196] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 548.244557] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.211250] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a1e916ca-ef9d-47f5-a617-89d1ab7f86ec demo admin] Enqueued Resource ID: 2977b8a4-aeb1-48a3-bb13-de8df10336ef with Priority: HIGHEST for action security_group_rules [ 553.211865] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2977b8a4-aeb1-48a3-bb13-de8df10336ef with Priority: HIGHEST for action security_group_rules [ 553.212195] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2977b8a4-aeb1-48a3-bb13-de8df10336ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.212326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2977b8a4-aeb1-48a3-bb13-de8df10336ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.212396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2977b8a4-aeb1-48a3-bb13-de8df10336ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.212750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2977b8a4-aeb1-48a3-bb13-de8df10336ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.212838] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2977b8a4-aeb1-48a3-bb13-de8df10336ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.738938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.739292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.739292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.739482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.739587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.739681] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2977b8a4-aeb1-48a3-bb13-de8df10336ef already deleted. [ 553.739768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2977b8a4-aeb1-48a3-bb13-de8df10336ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.212960] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.213702] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.214741] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.214741] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.215663] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.216073] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.217064] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.217460] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.218988] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 578.219323] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.059118] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0e227561-c32e-4cc6-be58-fe0865d63189 None None] Enqueued Resource ID: 55ed64e0-14e2-4436-8b5a-fb318b9ad6c4 with Priority: HIGHEST for action port [ 580.060037] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ed64e0-14e2-4436-8b5a-fb318b9ad6c4 with Priority: HIGHEST for action port [ 580.060037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-55ed64e0-14e2-4436-8b5a-fb318b9ad6c4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.060037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55ed64e0-14e2-4436-8b5a-fb318b9ad6c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.060375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55ed64e0-14e2-4436-8b5a-fb318b9ad6c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.060655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55ed64e0-14e2-4436-8b5a-fb318b9ad6c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.060742] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55ed64e0-14e2-4436-8b5a-fb318b9ad6c4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.564817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 55ed64e0-14e2-4436-8b5a-fb318b9ad6c4 [ 580.564817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.564817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.564817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.564817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.564817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.564817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:55ed64e0-14e2-4436-8b5a-fb318b9ad6c4 already deleted. [ 580.564817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55ed64e0-14e2-4436-8b5a-fb318b9ad6c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.244703] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.245581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.245581] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.749395] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.207389] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6efcded9-87c2-4d77-b738-dca016a9db59 None None] Enqueued Resource ID: 342b0356-de8c-4a78-908a-a574076eab97 with Priority: HIGHEST for action port [ 582.207933] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342b0356-de8c-4a78-908a-a574076eab97 with Priority: HIGHEST for action port [ 582.208779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-342b0356-de8c-4a78-908a-a574076eab97 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.208779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-342b0356-de8c-4a78-908a-a574076eab97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.208779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-342b0356-de8c-4a78-908a-a574076eab97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.209145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-342b0356-de8c-4a78-908a-a574076eab97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.209235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('342b0356-de8c-4a78-908a-a574076eab97',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.251774] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.712473] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 342b0356-de8c-4a78-908a-a574076eab97 [ 582.712711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.712850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.712936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.713146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.713240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.713364] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:342b0356-de8c-4a78-908a-a574076eab97 already deleted. [ 582.713502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-342b0356-de8c-4a78-908a-a574076eab97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.756431] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 582.756574] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 583.525046] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.525046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.525046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.525046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.536411] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 583.537515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.538577] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 583.557987] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.558246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.558360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.558734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.558878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.559017] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 583.559091] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.559164] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 583.580294] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.580470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.580506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.580733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.580874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.580986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 583.603765] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.603765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.603765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.603765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.603765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.603765] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 583.623658] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.623860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.623909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.624155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.625086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.625086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 583.625086] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.625086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 583.649027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.651019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.651019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.651019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.651019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.651019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 583.651019] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.651019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 583.677492] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.677492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.677816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.678245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.678538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.678960] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 583.679285] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 583.680246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 583.680246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 583.680246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 583.680246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 583.680246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 583.681103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 583.681103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 583.681103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 583.707254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.707439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.707560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.707714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.707828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.707941] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 583.730550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.730644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.730644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.730858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.730962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.747689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.823457] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ecba231c-af96-44cc-ae3f-b60d2a8c7b11 None None] Enqueued Resource ID: 17dca034-4f34-4b47-b58d-9c11cafd26e4 with Priority: HIGHEST for action port [ 584.823457] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17dca034-4f34-4b47-b58d-9c11cafd26e4 with Priority: HIGHEST for action port [ 584.823457] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-17dca034-4f34-4b47-b58d-9c11cafd26e4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.823457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17dca034-4f34-4b47-b58d-9c11cafd26e4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.824280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17dca034-4f34-4b47-b58d-9c11cafd26e4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.824280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17dca034-4f34-4b47-b58d-9c11cafd26e4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.824280] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17dca034-4f34-4b47-b58d-9c11cafd26e4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.856538] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0ddbc5dd-14cd-4954-9dcf-796667365ac7 None None] Enqueued Resource ID: 8c331993-a77e-4a58-a5d6-73371ed333db with Priority: HIGHEST for action port [ 584.860013] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c331993-a77e-4a58-a5d6-73371ed333db with Priority: HIGHEST for action port [ 584.860013] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c331993-a77e-4a58-a5d6-73371ed333db taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.860013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c331993-a77e-4a58-a5d6-73371ed333db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.860013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c331993-a77e-4a58-a5d6-73371ed333db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.860013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c331993-a77e-4a58-a5d6-73371ed333db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.860013] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c331993-a77e-4a58-a5d6-73371ed333db',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.326645] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17dca034-4f34-4b47-b58d-9c11cafd26e4 [ 585.326790] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.326931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.327065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.327249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.327394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.327465] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17dca034-4f34-4b47-b58d-9c11cafd26e4 already deleted. [ 585.327528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17dca034-4f34-4b47-b58d-9c11cafd26e4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.364505] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c331993-a77e-4a58-a5d6-73371ed333db [ 585.364742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.364878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.364949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.365186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.365371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.365475] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c331993-a77e-4a58-a5d6-73371ed333db already deleted. [ 585.365588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c331993-a77e-4a58-a5d6-73371ed333db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.714796] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a8f9f613-0bef-4756-8113-e7bb16c98dae None None] Enqueued Resource ID: 840522d4-788c-4ab5-8cb3-1eb555c443f6 with Priority: HIGHEST for action port [ 586.715213] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 840522d4-788c-4ab5-8cb3-1eb555c443f6 with Priority: HIGHEST for action port [ 586.715859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-840522d4-788c-4ab5-8cb3-1eb555c443f6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.715993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-840522d4-788c-4ab5-8cb3-1eb555c443f6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.716231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-840522d4-788c-4ab5-8cb3-1eb555c443f6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.716636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-840522d4-788c-4ab5-8cb3-1eb555c443f6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.716636] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('840522d4-788c-4ab5-8cb3-1eb555c443f6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.219357] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 840522d4-788c-4ab5-8cb3-1eb555c443f6 [ 587.219692] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.219872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.219971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.220250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.220432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.220607] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:840522d4-788c-4ab5-8cb3-1eb555c443f6 already deleted. [ 587.220721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-840522d4-788c-4ab5-8cb3-1eb555c443f6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.798890] env[65455]: INFO networking_nsxv3.common.synchronization [None req-858183e6-bd67-454f-b85c-aad0299c239a None None] Enqueued Resource ID: 4769fba8-57c2-449a-ac37-9f888b60ae18 with Priority: HIGHEST for action port [ 587.799605] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4769fba8-57c2-449a-ac37-9f888b60ae18 with Priority: HIGHEST for action port [ 587.799825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4769fba8-57c2-449a-ac37-9f888b60ae18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.799977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4769fba8-57c2-449a-ac37-9f888b60ae18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.800206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4769fba8-57c2-449a-ac37-9f888b60ae18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.801384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4769fba8-57c2-449a-ac37-9f888b60ae18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.801477] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4769fba8-57c2-449a-ac37-9f888b60ae18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.303469] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4769fba8-57c2-449a-ac37-9f888b60ae18 [ 588.303694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.303835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.303906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.304144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.304236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.304335] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4769fba8-57c2-449a-ac37-9f888b60ae18 already deleted. [ 588.304418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4769fba8-57c2-449a-ac37-9f888b60ae18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.400735] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7f329f1d-9d95-42ff-935e-442450b4a459 None None] Enqueued Resource ID: 944b332b-2c87-44bc-825d-ed80b4fa40c2 with Priority: HIGHEST for action port [ 588.400735] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944b332b-2c87-44bc-825d-ed80b4fa40c2 with Priority: HIGHEST for action port [ 588.400735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-944b332b-2c87-44bc-825d-ed80b4fa40c2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.400952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944b332b-2c87-44bc-825d-ed80b4fa40c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.400952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944b332b-2c87-44bc-825d-ed80b4fa40c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.403095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944b332b-2c87-44bc-825d-ed80b4fa40c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.403332] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944b332b-2c87-44bc-825d-ed80b4fa40c2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.579607] env[65455]: INFO networking_nsxv3.common.synchronization [None req-fe8b8338-4470-4266-bdbc-1bc9f388bdd3 None None] Enqueued Resource ID: 247493aa-34a9-45e3-8bea-fc851e65ecc9 with Priority: HIGHEST for action port [ 588.579607] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247493aa-34a9-45e3-8bea-fc851e65ecc9 with Priority: HIGHEST for action port [ 588.580102] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-247493aa-34a9-45e3-8bea-fc851e65ecc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.580244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-247493aa-34a9-45e3-8bea-fc851e65ecc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.580514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-247493aa-34a9-45e3-8bea-fc851e65ecc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.580633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-247493aa-34a9-45e3-8bea-fc851e65ecc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.580633] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('247493aa-34a9-45e3-8bea-fc851e65ecc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.907528] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 944b332b-2c87-44bc-825d-ed80b4fa40c2 [ 588.907528] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.907528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.907528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.907528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.907528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.907528] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:944b332b-2c87-44bc-825d-ed80b4fa40c2 already deleted. [ 588.907528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944b332b-2c87-44bc-825d-ed80b4fa40c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.084175] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 247493aa-34a9-45e3-8bea-fc851e65ecc9 [ 589.084421] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.085079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.085079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.085079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.085079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.085338] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:247493aa-34a9-45e3-8bea-fc851e65ecc9 already deleted. [ 589.085338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-247493aa-34a9-45e3-8bea-fc851e65ecc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.626142] env[65455]: INFO networking_nsxv3.common.synchronization [None req-2c1cb9d9-e990-4b76-be97-da9aa69c2455 None None] Enqueued Resource ID: bf2570ad-a766-41d1-be84-f8a138b07b13 with Priority: HIGHEST for action port [ 590.626771] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf2570ad-a766-41d1-be84-f8a138b07b13 with Priority: HIGHEST for action port [ 590.626974] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf2570ad-a766-41d1-be84-f8a138b07b13 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.627157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf2570ad-a766-41d1-be84-f8a138b07b13" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.627206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf2570ad-a766-41d1-be84-f8a138b07b13" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.629687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf2570ad-a766-41d1-be84-f8a138b07b13" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.629687] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf2570ad-a766-41d1-be84-f8a138b07b13',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.130507] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf2570ad-a766-41d1-be84-f8a138b07b13 [ 591.132209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.132523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.132523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.132877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.132877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.132877] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf2570ad-a766-41d1-be84-f8a138b07b13 already deleted. [ 591.133017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf2570ad-a766-41d1-be84-f8a138b07b13" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.549371] env[65455]: INFO networking_nsxv3.common.synchronization [None req-981ed27e-41f2-4fe7-8e1b-fa5fe98b7e3f None None] Enqueued Resource ID: e3e678a2-b97b-4ed0-9cdc-6675bec4e872 with Priority: HIGHEST for action port [ 591.550176] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e678a2-b97b-4ed0-9cdc-6675bec4e872 with Priority: HIGHEST for action port [ 591.550473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e678a2-b97b-4ed0-9cdc-6675bec4e872 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.550586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e678a2-b97b-4ed0-9cdc-6675bec4e872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.550655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e678a2-b97b-4ed0-9cdc-6675bec4e872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.550898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e678a2-b97b-4ed0-9cdc-6675bec4e872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.550983] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e678a2-b97b-4ed0-9cdc-6675bec4e872',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.578533] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ee9918b9-1e90-4270-9291-2adaea979e3d None None] Enqueued Resource ID: cd010e44-dca4-4e75-9816-930e5860f80a with Priority: HIGHEST for action port [ 591.579335] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd010e44-dca4-4e75-9816-930e5860f80a with Priority: HIGHEST for action port [ 591.579554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd010e44-dca4-4e75-9816-930e5860f80a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.579694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd010e44-dca4-4e75-9816-930e5860f80a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.579801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd010e44-dca4-4e75-9816-930e5860f80a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.580084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd010e44-dca4-4e75-9816-930e5860f80a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.580517] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd010e44-dca4-4e75-9816-930e5860f80a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.056261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3e678a2-b97b-4ed0-9cdc-6675bec4e872 [ 592.056564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.057014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.057014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.057189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.057331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.057446] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3e678a2-b97b-4ed0-9cdc-6675bec4e872 already deleted. [ 592.057546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e678a2-b97b-4ed0-9cdc-6675bec4e872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.083617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd010e44-dca4-4e75-9816-930e5860f80a [ 592.083617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.083617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.083617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.083617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.083617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.083617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd010e44-dca4-4e75-9816-930e5860f80a already deleted. [ 592.083617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd010e44-dca4-4e75-9816-930e5860f80a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.342080] env[65455]: INFO networking_nsxv3.common.synchronization [None req-cad7009c-95dd-43ef-af43-11f13ba001dd None None] Enqueued Resource ID: e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4 with Priority: HIGHEST for action port [ 593.342080] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4 with Priority: HIGHEST for action port [ 593.342080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.342415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.342415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.342485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.342724] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.741302] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6bcc0582-3012-42e0-aa9e-4c87b3f68137 None None] Enqueued Resource ID: 7e7911af-dfd3-4553-8bfb-572c912af0d4 with Priority: HIGHEST for action port [ 593.741564] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e7911af-dfd3-4553-8bfb-572c912af0d4 with Priority: HIGHEST for action port [ 593.745209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e7911af-dfd3-4553-8bfb-572c912af0d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.745355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e7911af-dfd3-4553-8bfb-572c912af0d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.745426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e7911af-dfd3-4553-8bfb-572c912af0d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.745738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e7911af-dfd3-4553-8bfb-572c912af0d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.745804] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7911af-dfd3-4553-8bfb-572c912af0d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.846121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4 [ 593.846365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.846501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.846573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.846997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.846997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.846997] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4 already deleted. [ 593.847216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e30c8994-71e9-4ee8-9c31-6e0e5e5abbf4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.133456] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a3d14f18-d13f-4ad0-b672-3e33c3fbf893 None None] Enqueued Resource ID: 4dc3b573-a60a-45f5-8d72-2f29d6e04679 with Priority: HIGHEST for action port [ 594.133997] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc3b573-a60a-45f5-8d72-2f29d6e04679 with Priority: HIGHEST for action port [ 594.134353] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc3b573-a60a-45f5-8d72-2f29d6e04679 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.134704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc3b573-a60a-45f5-8d72-2f29d6e04679" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.134704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc3b573-a60a-45f5-8d72-2f29d6e04679" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.134829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc3b573-a60a-45f5-8d72-2f29d6e04679" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.134865] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc3b573-a60a-45f5-8d72-2f29d6e04679',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.248713] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e7911af-dfd3-4553-8bfb-572c912af0d4 [ 594.248977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.249148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.249225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.249452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.249541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.249638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e7911af-dfd3-4553-8bfb-572c912af0d4 already deleted. [ 594.249723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e7911af-dfd3-4553-8bfb-572c912af0d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.639235] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dc3b573-a60a-45f5-8d72-2f29d6e04679 [ 594.639235] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.639235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.639235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.639235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.639235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.639235] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4dc3b573-a60a-45f5-8d72-2f29d6e04679 already deleted. [ 594.639235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc3b573-a60a-45f5-8d72-2f29d6e04679" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.168295] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8e04f376-572d-4fd3-a607-deff7bb2e16a None None] Enqueued Resource ID: 64382b2a-ecdc-4b9d-acf1-d66446f2a1c2 with Priority: HIGHEST for action port [ 595.168828] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64382b2a-ecdc-4b9d-acf1-d66446f2a1c2 with Priority: HIGHEST for action port [ 595.169190] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-64382b2a-ecdc-4b9d-acf1-d66446f2a1c2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.169321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64382b2a-ecdc-4b9d-acf1-d66446f2a1c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.169390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64382b2a-ecdc-4b9d-acf1-d66446f2a1c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.169633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64382b2a-ecdc-4b9d-acf1-d66446f2a1c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.169714] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64382b2a-ecdc-4b9d-acf1-d66446f2a1c2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.674400] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64382b2a-ecdc-4b9d-acf1-d66446f2a1c2 [ 595.674400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.674400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.674400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.674400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.674400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.674400] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64382b2a-ecdc-4b9d-acf1-d66446f2a1c2 already deleted. [ 595.674400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64382b2a-ecdc-4b9d-acf1-d66446f2a1c2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.987654] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a263c4a6-f03d-4769-8ffc-591737aca79e None None] Enqueued Resource ID: 77e97f39-7c45-433b-b384-23504496d5c4 with Priority: HIGHEST for action port [ 595.987911] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e97f39-7c45-433b-b384-23504496d5c4 with Priority: HIGHEST for action port [ 595.988452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-77e97f39-7c45-433b-b384-23504496d5c4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.988583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77e97f39-7c45-433b-b384-23504496d5c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.989133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77e97f39-7c45-433b-b384-23504496d5c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.989936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77e97f39-7c45-433b-b384-23504496d5c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.989936] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77e97f39-7c45-433b-b384-23504496d5c4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.492757] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77e97f39-7c45-433b-b384-23504496d5c4 [ 596.492757] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.492855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.492889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.493206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.493300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.493416] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77e97f39-7c45-433b-b384-23504496d5c4 already deleted. [ 596.493526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77e97f39-7c45-433b-b384-23504496d5c4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.023044] env[65455]: INFO networking_nsxv3.common.synchronization [None req-28aceb16-a117-4075-a8e1-2655794ddae3 None None] Enqueued Resource ID: 73d9c87d-e091-41b8-aa0c-c79b99509d98 with Priority: HIGHEST for action port [ 598.023644] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73d9c87d-e091-41b8-aa0c-c79b99509d98 with Priority: HIGHEST for action port [ 598.024036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-73d9c87d-e091-41b8-aa0c-c79b99509d98 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.024234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73d9c87d-e091-41b8-aa0c-c79b99509d98" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.024317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73d9c87d-e091-41b8-aa0c-c79b99509d98" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.024682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73d9c87d-e091-41b8-aa0c-c79b99509d98" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.024848] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73d9c87d-e091-41b8-aa0c-c79b99509d98',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.528672] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73d9c87d-e091-41b8-aa0c-c79b99509d98 [ 598.528672] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.528672] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.530440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.530440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.530440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.530606] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73d9c87d-e091-41b8-aa0c-c79b99509d98 already deleted. [ 598.530606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73d9c87d-e091-41b8-aa0c-c79b99509d98" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.717411] env[65455]: INFO networking_nsxv3.common.synchronization [req-955f0f56-b781-47e8-aff2-1015cf1be469 req-cd96f659-1c7a-43b3-b69b-7c22ccce65c7 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 598.717508] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 598.717795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.717964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.717999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.720228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.720423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.720543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.720610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.720796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.720879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.720972] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.219335] env[65455]: INFO networking_nsxv3.common.synchronization [None req-b123bb6a-155f-46d6-866b-2d58f57b1ee7 None None] Enqueued Resource ID: c2640b96-745b-49f1-bcd6-9860c093e29e with Priority: HIGHEST for action port [ 599.220109] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2640b96-745b-49f1-bcd6-9860c093e29e with Priority: HIGHEST for action port [ 599.220109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2640b96-745b-49f1-bcd6-9860c093e29e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.220197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2640b96-745b-49f1-bcd6-9860c093e29e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.220275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2640b96-745b-49f1-bcd6-9860c093e29e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.220526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2640b96-745b-49f1-bcd6-9860c093e29e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.220626] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2640b96-745b-49f1-bcd6-9860c093e29e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.225690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.225948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.226025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.226293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.226428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.226733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.226874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.226992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.227311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.227347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.227473] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 already deleted. [ 599.227601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.647804] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.647804] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.647804] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.648528] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.649201] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.649308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.649752] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.649987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.651392] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.651392] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.651392] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.651392] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.651392] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.651392] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.651392] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.651392] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.677424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.677702] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.679994] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.679994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.679994] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.679994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.679994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.679994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.679994] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb3b212-8503-480d-b0f0-f3f7f20c5e9e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.722451] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2640b96-745b-49f1-bcd6-9860c093e29e [ 599.722722] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.722835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.722871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.723451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.723451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.723451] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2640b96-745b-49f1-bcd6-9860c093e29e already deleted. [ 599.723451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2640b96-745b-49f1-bcd6-9860c093e29e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.182055] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.182055] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.182055] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.182352] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.182506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.182680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e not found, creating... [ 600.183533] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.183533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.183533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.183533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.183533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.183916] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.184090] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.184209] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.184417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.184546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.184792] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e is going to be created. [ 600.206033] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.206486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.206579] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.206774] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.207040] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.207298] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.583729] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7c5fd648-a63d-40ba-8bfe-4827018bf162 None None] Enqueued Resource ID: c1e6088d-cd2f-4091-9a65-72e8f84d7a94 with Priority: HIGHEST for action port [ 600.586767] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1e6088d-cd2f-4091-9a65-72e8f84d7a94 with Priority: HIGHEST for action port [ 600.587680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1e6088d-cd2f-4091-9a65-72e8f84d7a94 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.587680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1e6088d-cd2f-4091-9a65-72e8f84d7a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.587680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1e6088d-cd2f-4091-9a65-72e8f84d7a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.587680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1e6088d-cd2f-4091-9a65-72e8f84d7a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.587680] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1e6088d-cd2f-4091-9a65-72e8f84d7a94',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.871041] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5c3bced8-e2e8-4e8b-a164-d8ce272d09f5 None None] Enqueued Resource ID: db8107a6-86d8-44d8-abe3-9cddb6718585 with Priority: HIGHEST for action port [ 600.871041] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8107a6-86d8-44d8-abe3-9cddb6718585 with Priority: HIGHEST for action port [ 600.871041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8107a6-86d8-44d8-abe3-9cddb6718585 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.871041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8107a6-86d8-44d8-abe3-9cddb6718585" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.871041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8107a6-86d8-44d8-abe3-9cddb6718585" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.871891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8107a6-86d8-44d8-abe3-9cddb6718585" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.872100] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8107a6-86d8-44d8-abe3-9cddb6718585',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.986087] env[65455]: INFO networking_nsxv3.common.synchronization [None req-2f144d56-c232-40b6-97dd-22d94d4647d2 tempest-VolumesAssistedSnapshotsTest-1816646194 tempest-VolumesAssistedSnapshotsTest-1816646194-project-member] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 600.986789] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 600.987308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.987588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.987765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.988134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.988347] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.091872] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1e6088d-cd2f-4091-9a65-72e8f84d7a94 [ 601.093980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.093980] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1e6088d-cd2f-4091-9a65-72e8f84d7a94 already deleted. [ 601.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1e6088d-cd2f-4091-9a65-72e8f84d7a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.269812] env[65455]: INFO networking_nsxv3.common.synchronization [req-955f0f56-b781-47e8-aff2-1015cf1be469 req-98593a20-f672-4249-9e22-8ee2dcc374a5 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 601.269812] env[65455]: INFO networking_nsxv3.common.synchronization [req-955f0f56-b781-47e8-aff2-1015cf1be469 req-98593a20-f672-4249-9e22-8ee2dcc374a5 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 601.269812] env[65455]: INFO networking_nsxv3.common.synchronization [req-955f0f56-b781-47e8-aff2-1015cf1be469 req-98593a20-f672-4249-9e22-8ee2dcc374a5 service nova] Enqueued Resource ID: 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e with Priority: HIGHEST for action port [ 601.270739] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 601.271107] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 601.271107] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e with Priority: HIGHEST for action port [ 601.271297] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.271410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.271467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.271714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.271796] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.272619] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.272718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.272785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.272974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.273198] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.273276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.273276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.273713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.273713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.273713] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.277013] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.277145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.277247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.277726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.277726] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb3b212-8503-480d-b0f0-f3f7f20c5e9e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.310094] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7cfeba5f-02c2-44a5-a74e-7274c50d31f6 tempest-VolumesAssistedSnapshotsTest-1816646194 tempest-VolumesAssistedSnapshotsTest-1816646194-project-member] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 601.310969] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 601.312837] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.312837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.375422] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db8107a6-86d8-44d8-abe3-9cddb6718585 [ 601.378018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.378018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.378018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.378018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.378018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.378018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db8107a6-86d8-44d8-abe3-9cddb6718585 already deleted. [ 601.378018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8107a6-86d8-44d8-abe3-9cddb6718585" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.512888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.512888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 already deleted. [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.512888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.512888] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.757041] env[65455]: INFO networking_nsxv3.common.synchronization [req-51193214-9106-4275-9596-8022aa739b8f req-aaca7d84-d9ac-45dd-bb71-4e2d2b337597 tempest-DeleteServersAdminTestJSON-968335089 tempest-DeleteServersAdminTestJSON-968335089-project-member] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 601.757041] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 601.757041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.757041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.757041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.757041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.757041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.757544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.757544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.757544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.757544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.757544] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.779114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.779284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.787991] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.789170] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e with status ACTIVE [ 601.789316] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.789444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.789514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.789723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.789810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.790084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.790084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.790218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.790294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.790375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.790551] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.790705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.790705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.790836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.790911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.790996] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0eb3b212-8503-480d-b0f0-f3f7f20c5e9e is going to be updated. [ 601.816052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.816211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.816283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.816493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.816634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.816801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eb3b212-8503-480d-b0f0-f3f7f20c5e9e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.825103] env[65455]: INFO networking_nsxv3.common.synchronization [None req-4053dda4-29aa-44e9-8c40-2638001099a8 None None] Enqueued Resource ID: c495555f-a195-4b10-b2c5-deb45aa78522 with Priority: HIGHEST for action port [ 601.825650] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c495555f-a195-4b10-b2c5-deb45aa78522 with Priority: HIGHEST for action port [ 601.826582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c495555f-a195-4b10-b2c5-deb45aa78522 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.826582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c495555f-a195-4b10-b2c5-deb45aa78522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.826582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c495555f-a195-4b10-b2c5-deb45aa78522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.828306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c495555f-a195-4b10-b2c5-deb45aa78522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.828306] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c495555f-a195-4b10-b2c5-deb45aa78522',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.036600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.036600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.036600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.036834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.036834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.036834] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 already deleted. [ 602.036996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.128895] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.129109] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.129218] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.129585] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.129843] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.129997] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.130135] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.130338] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.130471] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.130669] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.130776] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.130881] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.130993] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.131162] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.131225] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.131310] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.152305] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.152305] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.152305] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.152305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.152522] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-f0d9a4f7-94c7-4feb-861a-461365c0cca8 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.152891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.152891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.153310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.153310] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0d9a4f7-94c7-4feb-861a-461365c0cca8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.262308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.262308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.262308] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 already deleted. [ 602.262308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.293923] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.329855] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c495555f-a195-4b10-b2c5-deb45aa78522 [ 602.330133] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.330317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.330415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.330665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.330761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.330856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c495555f-a195-4b10-b2c5-deb45aa78522 already deleted. [ 602.330942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c495555f-a195-4b10-b2c5-deb45aa78522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.655157] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.655385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.655477] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.655737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.655874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.656078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port f0d9a4f7-94c7-4feb-861a-461365c0cca8 not found, creating... [ 602.656278] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.656427] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.656536] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.656748] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.656877] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.657185] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.657342] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.657666] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.657879] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.658041] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.658181] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: f0d9a4f7-94c7-4feb-861a-461365c0cca8 is going to be created. [ 602.678115] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.678335] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.678456] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.678728] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.678934] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.679167] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.796769] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.796769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.798498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.798498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.798498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.798498] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be created. [ 602.834021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.834021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.834021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.834021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.834021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.843892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: UNINITIALIZED for 2s [ 603.399385] env[65455]: INFO networking_nsxv3.common.synchronization [req-51193214-9106-4275-9596-8022aa739b8f req-8a7765e2-b15a-4f07-9de9-6ec5a825401f service nova] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_rules [ 603.399494] env[65455]: INFO networking_nsxv3.common.synchronization [req-51193214-9106-4275-9596-8022aa739b8f req-8a7765e2-b15a-4f07-9de9-6ec5a825401f service nova] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 603.400514] env[65455]: INFO networking_nsxv3.common.synchronization [req-51193214-9106-4275-9596-8022aa739b8f req-8a7765e2-b15a-4f07-9de9-6ec5a825401f service nova] Enqueued Resource ID: f0d9a4f7-94c7-4feb-861a-461365c0cca8 with Priority: HIGHEST for action port [ 603.400514] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_rules [ 603.400638] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 603.400735] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0d9a4f7-94c7-4feb-861a-461365c0cca8 with Priority: HIGHEST for action port [ 603.400983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.401967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.401967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.401967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.401967] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.402776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.402776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.402776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.402776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.402969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.402969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.403067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.403162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.403239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.403321] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.404664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0d9a4f7-94c7-4feb-861a-461365c0cca8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.404813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.404959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.406038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.406038] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0d9a4f7-94c7-4feb-861a-461365c0cca8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.417932] env[65455]: INFO networking_nsxv3.common.synchronization [req-01026ef5-560c-4983-8343-cc7d11a496d0 req-caff0ba8-bc4e-4c77-9996-986f1d50cdda tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 603.418166] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 603.418388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.418507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.418573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.418821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.419043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.420072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.420265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.420800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.420922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.421128] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.810145] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.810498] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-875" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.810498] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-875" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.810844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-875" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.811081] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.811484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.811484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.811684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.811827] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.814061] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.814239] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.814359] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.814467] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.814584] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.814677] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.814826] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.835609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.835766] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.836454] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.836454] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-875" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.836454] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-f19a3a49-a886-4a96-9138-06d79373ec05 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.836719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.836719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.837333] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.837333] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19a3a49-a886-4a96-9138-06d79373ec05',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.907367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.907504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.907683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0d9a4f7-94c7-4feb-861a-461365c0cca8 with status ACTIVE [ 603.907851] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.907979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.908069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.908278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.908365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.908529] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.908623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.908685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.908828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.908917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.912021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.912021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0d9a4f7-94c7-4feb-861a-461365c0cca8 is going to be updated. [ 603.912021] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.925200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.925200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.925200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.925430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.925430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.925530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.925615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.925678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.925827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.925905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.925989] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 already deleted. [ 603.926086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.932480] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.934232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.934232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.934232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.934232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.934232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0d9a4f7-94c7-4feb-861a-461365c0cca8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.935999] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f7cb2c69-d565-4fd3-97d8-a7a12ca51210 None None] Enqueued Resource ID: 11efd5f5-b945-4262-83ea-267639a7e11c with Priority: HIGHEST for action port [ 603.936753] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11efd5f5-b945-4262-83ea-267639a7e11c with Priority: HIGHEST for action port [ 603.937073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-11efd5f5-b945-4262-83ea-267639a7e11c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.937188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11efd5f5-b945-4262-83ea-267639a7e11c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.937253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11efd5f5-b945-4262-83ea-267639a7e11c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.937864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11efd5f5-b945-4262-83ea-267639a7e11c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.937951] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11efd5f5-b945-4262-83ea-267639a7e11c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.995046] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d44d6ea2-9861-4905-ba9b-ca6bbb8ef394 None None] Enqueued Resource ID: afd93aa1-4fd6-4cdf-abb5-86156746ee17 with Priority: HIGHEST for action port [ 603.995892] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd93aa1-4fd6-4cdf-abb5-86156746ee17 with Priority: HIGHEST for action port [ 603.996241] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-afd93aa1-4fd6-4cdf-abb5-86156746ee17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.996370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afd93aa1-4fd6-4cdf-abb5-86156746ee17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.996438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afd93aa1-4fd6-4cdf-abb5-86156746ee17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.997285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afd93aa1-4fd6-4cdf-abb5-86156746ee17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.997414] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd93aa1-4fd6-4cdf-abb5-86156746ee17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.340021] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.340211] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.340211] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.340464] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.340601] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.340738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port f19a3a49-a886-4a96-9138-06d79373ec05 not found, creating... [ 604.340986] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.341684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.341684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.341684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.341684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.341917] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.341981] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.342647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.342647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.342647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.342647] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: f19a3a49-a886-4a96-9138-06d79373ec05 is going to be created. [ 604.364020] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.364218] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.364338] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.364616] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.364956] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.365111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.414265] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.441778] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11efd5f5-b945-4262-83ea-267639a7e11c [ 604.442056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.442135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.442211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.442654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.442810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.443041] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11efd5f5-b945-4262-83ea-267639a7e11c already deleted. [ 604.443182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11efd5f5-b945-4262-83ea-267639a7e11c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.500126] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afd93aa1-4fd6-4cdf-abb5-86156746ee17 [ 604.501018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.501954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.501954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.501954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.501954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.501954] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afd93aa1-4fd6-4cdf-abb5-86156746ee17 already deleted. [ 604.501954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afd93aa1-4fd6-4cdf-abb5-86156746ee17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.854142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 604.854502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.855428] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.855428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.855778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.855945] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.918153] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.918330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.918374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.918571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.918664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.918758] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be created. [ 604.946968] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.947180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.947228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.947851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.947851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.959856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: UNINITIALIZED for 2s [ 605.109496] env[65455]: INFO networking_nsxv3.common.synchronization [req-01026ef5-560c-4983-8343-cc7d11a496d0 req-70374d85-f327-4193-ac21-1d1add835529 service nova] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 605.109496] env[65455]: INFO networking_nsxv3.common.synchronization [req-01026ef5-560c-4983-8343-cc7d11a496d0 req-70374d85-f327-4193-ac21-1d1add835529 service nova] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 605.109496] env[65455]: INFO networking_nsxv3.common.synchronization [req-01026ef5-560c-4983-8343-cc7d11a496d0 req-70374d85-f327-4193-ac21-1d1add835529 service nova] Enqueued Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 605.109671] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 605.109766] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 605.109845] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 605.110425] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.110577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.110624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.110867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.110928] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.115545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.115545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.115545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.115764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.116836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.116836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.116836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.116836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.116836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.116836] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.118468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f19a3a49-a886-4a96-9138-06d79373ec05 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.118468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.118468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.118468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.118468] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19a3a49-a886-4a96-9138-06d79373ec05',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.363171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.363171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.363171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.363171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.363340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.363453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.363517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.363690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.363782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.363867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.364173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.364257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.364294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.364423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.364565] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.364654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.364753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.364849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.364929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.365021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.365158] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.392328] env[65455]: INFO networking_nsxv3.common.synchronization [None req-9779d25a-1c70-4fe1-9eac-47570165ad2e tempest-ServersTestFqdnHostnames-1791544921 tempest-ServersTestFqdnHostnames-1791544921-project-member] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 605.392932] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 605.393130] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.393258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.393325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.394244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.394244] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.487594] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c466df7e-822d-40c4-aa72-e2afa60cf4b5 tempest-ServersTestFqdnHostnames-1791544921 tempest-ServersTestFqdnHostnames-1791544921-project-member] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 605.488665] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 605.489148] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.489446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.620584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.620584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.622409] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f19a3a49-a886-4a96-9138-06d79373ec05 with status ACTIVE [ 605.622573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623364] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.623649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.623649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.623776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.624053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.624133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.624273] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f19a3a49-a886-4a96-9138-06d79373ec05 is going to be updated. [ 605.625422] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.648958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.649251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.649329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.649555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.649677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.649830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.870428] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 605.891366] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.891366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.891366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.894523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.895227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.895655] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.895947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.897047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.897047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.897230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.897436] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.897588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.897722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.899199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.899199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.899660] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be created. [ 605.936030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.936030] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ec5c2d-0701-464f-b730-022584dac61b already deleted. [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.936030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.936030] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.985567] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.985757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.985805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.986107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.986321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.001125] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 606.128537] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.188566] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d7ba9969-2d4a-4698-b2ce-2ea47eb8df59 None None] Enqueued Resource ID: 92527885-118c-43a6-81f5-dd8732d41fa0 with Priority: HIGHEST for action port [ 606.189023] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92527885-118c-43a6-81f5-dd8732d41fa0 with Priority: HIGHEST for action port [ 606.189912] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-92527885-118c-43a6-81f5-dd8732d41fa0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.190055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92527885-118c-43a6-81f5-dd8732d41fa0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.190597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92527885-118c-43a6-81f5-dd8732d41fa0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.190597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92527885-118c-43a6-81f5-dd8732d41fa0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.190597] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92527885-118c-43a6-81f5-dd8732d41fa0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.459970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.459970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.459970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.459970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.459970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.459970] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ec5c2d-0701-464f-b730-022584dac61b already deleted. [ 606.459970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.631724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.631927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.632009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.632258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.632353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.632467] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be created. [ 606.656356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.656557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.656632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.656881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.657053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.666285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: UNINITIALIZED for 2s [ 606.692779] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92527885-118c-43a6-81f5-dd8732d41fa0 [ 606.693045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.693368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.693449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.693620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.693715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.693802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92527885-118c-43a6-81f5-dd8732d41fa0 already deleted. [ 606.693884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92527885-118c-43a6-81f5-dd8732d41fa0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.968919] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 606.968919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.968919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.969369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.969369] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.969984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.969984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.969984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.969984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.969984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.969984] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.473174] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.473343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.473439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.473642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.473830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.473927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.473999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.474169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.474253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.474355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.474500] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.474596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.474660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.475989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.475989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.475989] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.978654] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c141c29-42c3-41f9-b7dc-ffdc17a6c975: rpc.has_security_group_logging(os_id): False [ 607.998016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.998150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.998202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.998440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.998556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.998838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.999816] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.999816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.000847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.000847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.000847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.000847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.000847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.000847] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be created. [ 608.017487] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 608.017767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.061422] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.061422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.061422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.061422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.061422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.073468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 608.678922] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680863] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.680863] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.183892] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.184225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.184355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.184530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.184719] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.184840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.184913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.185100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.185193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.185304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.185546] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.185546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.185673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.185707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.185887] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.185972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.186348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.186348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.186348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.186348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.186507] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.690103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b30223-71ca-4cf7-ab29-768aa4761f18: rpc.has_security_group_logging(os_id): False [ 609.709396] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.709573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.709642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.709864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.709949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.710170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.710269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.710333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.710495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.710574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.710776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.710873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.710912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.711529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.711699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.711944] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.712422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.712771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.713404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.713455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.713717] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be created. [ 609.778545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.778545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.778545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.778545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.778545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.794522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 609.807270] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1b9ceee8-438f-45d9-9dff-417f7a36e0f4 None None] Enqueued Resource ID: 8a1af223-6b74-4a61-9ef5-1f49a3e99af5 with Priority: HIGHEST for action port [ 609.807833] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a1af223-6b74-4a61-9ef5-1f49a3e99af5 with Priority: HIGHEST for action port [ 609.808130] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a1af223-6b74-4a61-9ef5-1f49a3e99af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.808267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a1af223-6b74-4a61-9ef5-1f49a3e99af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.808333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a1af223-6b74-4a61-9ef5-1f49a3e99af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.808614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a1af223-6b74-4a61-9ef5-1f49a3e99af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.808852] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a1af223-6b74-4a61-9ef5-1f49a3e99af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.088856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 610.089089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.318720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a1af223-6b74-4a61-9ef5-1f49a3e99af5 [ 610.318720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.318720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.318720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.318720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.318720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.318720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a1af223-6b74-4a61-9ef5-1f49a3e99af5 already deleted. [ 610.318720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a1af223-6b74-4a61-9ef5-1f49a3e99af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.439258] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f4b10710-43a1-437b-8f75-f2422d420860 None None] Enqueued Resource ID: 65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0 with Priority: HIGHEST for action port [ 610.440893] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0 with Priority: HIGHEST for action port [ 610.440893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.440893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.440893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.440893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.441212] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.698422] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f500d34-6c10-4b4d-9a2f-5db412725ffa req-e76bd698-0830-478e-8253-610062945551 tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 610.702368] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 610.702368] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.702530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.702567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.702805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.702954] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.703067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.703131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.703288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.703374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.703468] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.944672] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0 [ 610.944928] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.945159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.945159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.946123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.946123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.946123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0 already deleted. [ 610.946123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65a3acbd-9f6e-4ee8-96f9-dcb2e741bea0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.205571] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.206345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.206459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.206965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.207130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.207351] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.207459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.207802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.208207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.208207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.208308] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c already deleted. [ 611.208308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.312259] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.312259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.312259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.312259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.312526] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.312680] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.312826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.313233] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.313298] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.313752] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.313752] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.313752] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.313890] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.313890] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.313960] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.314092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.336963] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.337252] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.337306] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.337451] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.338101] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.338101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.338101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.338392] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.338519] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da140fc0-0fdc-4bb5-a51c-5692a630d4c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.809185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 611.809545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.843644] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.843644] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.843644] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.843949] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.843949] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.844957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port da140fc0-0fdc-4bb5-a51c-5692a630d4c0 not found, creating... [ 611.846163] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.846163] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.846163] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.846163] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.846523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.848217] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.848217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.848217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.848217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.848217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.848217] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: da140fc0-0fdc-4bb5-a51c-5692a630d4c0 is going to be created. [ 611.871083] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.871452] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.871452] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.871717] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.872798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.872798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.333093] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6d412841-79b0-4ab1-b28d-e17d196d1422 None None] Enqueued Resource ID: 92289ff3-6566-43a3-9cf5-710387c7e04c with Priority: HIGHEST for action port [ 612.336848] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92289ff3-6566-43a3-9cf5-710387c7e04c with Priority: HIGHEST for action port [ 612.336848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-92289ff3-6566-43a3-9cf5-710387c7e04c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.336848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92289ff3-6566-43a3-9cf5-710387c7e04c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.336848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92289ff3-6566-43a3-9cf5-710387c7e04c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.336848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92289ff3-6566-43a3-9cf5-710387c7e04c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.336848] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92289ff3-6566-43a3-9cf5-710387c7e04c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.566383] env[65455]: INFO networking_nsxv3.common.synchronization [None req-b70528d8-cb11-439f-9471-2e435ebf9ab9 None None] Enqueued Resource ID: 8ae719ca-de2d-4070-812f-0f91385cb5e5 with Priority: HIGHEST for action port [ 612.567661] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae719ca-de2d-4070-812f-0f91385cb5e5 with Priority: HIGHEST for action port [ 612.568079] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae719ca-de2d-4070-812f-0f91385cb5e5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.568681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae719ca-de2d-4070-812f-0f91385cb5e5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.569549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae719ca-de2d-4070-812f-0f91385cb5e5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.569549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae719ca-de2d-4070-812f-0f91385cb5e5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.569549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae719ca-de2d-4070-812f-0f91385cb5e5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.719915] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f500d34-6c10-4b4d-9a2f-5db412725ffa req-9a11a892-23bf-41a7-8d29-2d28e0dc169c service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 612.720230] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f500d34-6c10-4b4d-9a2f-5db412725ffa req-9a11a892-23bf-41a7-8d29-2d28e0dc169c service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 612.720298] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f500d34-6c10-4b4d-9a2f-5db412725ffa req-9a11a892-23bf-41a7-8d29-2d28e0dc169c service nova] Enqueued Resource ID: da140fc0-0fdc-4bb5-a51c-5692a630d4c0 with Priority: HIGHEST for action port [ 612.720512] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 612.720636] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 612.720731] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da140fc0-0fdc-4bb5-a51c-5692a630d4c0 with Priority: HIGHEST for action port [ 612.721365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.721476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.721520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.721764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.721840] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.722686] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.722814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.722852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.723032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.723242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.723315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.723348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.723512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.723545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.723630] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.724598] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.724748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.724799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.725666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.725666] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da140fc0-0fdc-4bb5-a51c-5692a630d4c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.775633] env[65455]: INFO networking_nsxv3.common.synchronization [req-6493120c-1315-4666-b86d-26d395a19044 req-6a8b1843-9d53-4e73-8831-6927a8d681fc tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 612.776691] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 612.776691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.776691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.776691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.777067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.777153] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.777276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.777329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.777477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.777557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.777649] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.839399] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92289ff3-6566-43a3-9cf5-710387c7e04c [ 612.840252] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.841589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.841589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.841589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.841589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.841589] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92289ff3-6566-43a3-9cf5-710387c7e04c already deleted. [ 612.841589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92289ff3-6566-43a3-9cf5-710387c7e04c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.074901] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ae719ca-de2d-4070-812f-0f91385cb5e5 [ 613.074901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.074901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.074901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.074901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.074901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.074901] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ae719ca-de2d-4070-812f-0f91385cb5e5 already deleted. [ 613.074901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae719ca-de2d-4070-812f-0f91385cb5e5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.231232] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.231232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.231232] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da140fc0-0fdc-4bb5-a51c-5692a630d4c0 with status ACTIVE [ 613.231232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.231232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.231232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.231707] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.231707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.232614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.234097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.234097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.234097] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da140fc0-0fdc-4bb5-a51c-5692a630d4c0 is going to be updated. [ 613.259280] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.260500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.260500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.260500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.260500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.260500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da140fc0-0fdc-4bb5-a51c-5692a630d4c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.280326] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.282293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.282293] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 already deleted. [ 613.282293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.487252] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.487638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.487937] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.488578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.488969] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.489200] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.489364] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.489638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.489919] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.490672] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.490828] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.491008] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.491169] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.491442] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.491579] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.491833] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.514509] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.514858] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.515120] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.515435] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.515932] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-32598b78-675a-4141-b372-4f67ab7dced6 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.516164] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.516422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.516900] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.517091] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32598b78-675a-4141-b372-4f67ab7dced6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.737383] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.019572] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.019848] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.020065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.020846] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.020846] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.021212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 32598b78-675a-4141-b372-4f67ab7dced6 not found, creating... [ 614.021259] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.021448] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.021620] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.021899] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.022080] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.022441] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.022593] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.022964] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.022964] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.023121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.023285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 32598b78-675a-4141-b372-4f67ab7dced6 is going to be created. [ 614.047291] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.047513] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.047622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.047993] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.048350] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.048758] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.169047] env[65455]: INFO networking_nsxv3.common.synchronization [None req-25bf0c9c-e344-4f42-9dea-2e7eb4ed29f8 None None] Enqueued Resource ID: 10de2336-fa6e-49d4-9063-c5e60453b0f1 with Priority: HIGHEST for action port [ 614.169727] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10de2336-fa6e-49d4-9063-c5e60453b0f1 with Priority: HIGHEST for action port [ 614.169968] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-10de2336-fa6e-49d4-9063-c5e60453b0f1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.170221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10de2336-fa6e-49d4-9063-c5e60453b0f1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.170283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10de2336-fa6e-49d4-9063-c5e60453b0f1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.170534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10de2336-fa6e-49d4-9063-c5e60453b0f1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.170616] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10de2336-fa6e-49d4-9063-c5e60453b0f1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.240205] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.240398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.240503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.240838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.240968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.241125] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be created. [ 614.271495] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.271645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.271709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.272064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.272263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.283270] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: UNINITIALIZED for 2s [ 614.672766] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10de2336-fa6e-49d4-9063-c5e60453b0f1 [ 614.673201] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.673313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.673390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.673818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.673938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.674095] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10de2336-fa6e-49d4-9063-c5e60453b0f1 already deleted. [ 614.674554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10de2336-fa6e-49d4-9063-c5e60453b0f1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.785457] env[65455]: INFO networking_nsxv3.common.synchronization [req-6493120c-1315-4666-b86d-26d395a19044 req-72d2f8e1-3666-4c8d-9373-4db9fe330701 service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 614.786388] env[65455]: INFO networking_nsxv3.common.synchronization [req-6493120c-1315-4666-b86d-26d395a19044 req-72d2f8e1-3666-4c8d-9373-4db9fe330701 service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 614.786388] env[65455]: INFO networking_nsxv3.common.synchronization [req-6493120c-1315-4666-b86d-26d395a19044 req-72d2f8e1-3666-4c8d-9373-4db9fe330701 service nova] Enqueued Resource ID: 32598b78-675a-4141-b372-4f67ab7dced6 with Priority: HIGHEST for action port [ 614.786388] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 614.786605] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 614.786605] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32598b78-675a-4141-b372-4f67ab7dced6 with Priority: HIGHEST for action port [ 614.786792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.786916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.786979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.787939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.788189] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.790324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.790324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.790324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.790324] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.791860] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-32598b78-675a-4141-b372-4f67ab7dced6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.791860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.791860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.792092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.792092] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32598b78-675a-4141-b372-4f67ab7dced6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.802022] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0986889e-2252-411a-ad3e-32d2513688b6 tempest-ServersV294TestFqdnHostnames-2000943012 tempest-ServersV294TestFqdnHostnames-2000943012-project-member] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 614.802022] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 614.802022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.802022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.802022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.802022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.802022] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.140766] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ea981d00-d816-4cda-8af8-16f2a3c4e631 tempest-ServersV294TestFqdnHostnames-2000943012 tempest-ServersV294TestFqdnHostnames-2000943012-project-member] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 615.140766] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 615.140766] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.140766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.292686] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.293928] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.294092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.294270] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32598b78-675a-4141-b372-4f67ab7dced6 with status ACTIVE [ 615.294382] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.294748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.294748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.294748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.294913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.294999] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.295249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.295249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.295338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.295396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.295561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.295651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.295708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.296161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.296161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.296161] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32598b78-675a-4141-b372-4f67ab7dced6 is going to be updated. [ 615.329686] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.329963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.330113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.330459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.331350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.331350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32598b78-675a-4141-b372-4f67ab7dced6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.334397] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.334517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.334641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.335187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.335187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.335336] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 already deleted. [ 615.335409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.337346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.337932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.338156] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.548240] env[65455]: INFO networking_nsxv3.common.synchronization [req-c412ff21-4c6f-48f3-a5e2-0d6137bcbc1e req-986bb972-5a88-42d1-8555-0e44efece10a tempest-InstanceActionsV221TestJSON-1232867568 tempest-InstanceActionsV221TestJSON-1232867568-project-member] Enqueued Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 615.548240] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 615.549316] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.549453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.549453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.549911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.550095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.550335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.550482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.550665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.550776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.550883] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.794843] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.862684] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.862684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.862852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.862978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.863093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.863188] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 already deleted. [ 615.863270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.056756] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.056995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.057087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.057338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.057440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.057989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.057989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.057989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.058250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.058766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.058915] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a already deleted. [ 616.059772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.191012] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e61a253e-b7f6-41b1-bb75-48eac4295ebe None None] Enqueued Resource ID: 7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb with Priority: HIGHEST for action port [ 616.191566] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb with Priority: HIGHEST for action port [ 616.191877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.192060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.192247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.192802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.192802] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.236939] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-204 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.237121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.238026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.238137] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.240694] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.240694] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.240875] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.241034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.241189] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.245060] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.245060] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.245060] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.245060] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.245060] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.245060] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.245060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.263905] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.264095] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.264233] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.264435] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.264806] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-ddd90c87-997d-4666-82ea-248aa4cdac4b taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.265065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.265140] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.265443] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.265571] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd90c87-997d-4666-82ea-248aa4cdac4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.296305] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 616.297139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.297139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.297292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.297555] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.297555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.297763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.297838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.297925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.297925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.298034] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.299142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.299276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.299314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.299500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.301044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.301044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be created. [ 616.326950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.326950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.326950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.326950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.327323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.337110] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: UNINITIALIZED for 2s [ 616.411458] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1291ff54-0d51-45e3-91fd-cd6be2666157 None None] Enqueued Resource ID: cc61c851-c763-4376-85e6-34d53cea2be7 with Priority: HIGHEST for action port [ 616.411458] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc61c851-c763-4376-85e6-34d53cea2be7 with Priority: HIGHEST for action port [ 616.411683] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc61c851-c763-4376-85e6-34d53cea2be7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.411993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc61c851-c763-4376-85e6-34d53cea2be7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.411993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc61c851-c763-4376-85e6-34d53cea2be7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.412159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc61c851-c763-4376-85e6-34d53cea2be7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.412503] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc61c851-c763-4376-85e6-34d53cea2be7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.695596] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb [ 616.695835] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.695968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.696063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.696322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.696416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.696517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb already deleted. [ 616.696628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cbb71e9-f2bf-4a0c-9dc8-c4339bb946fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.768212] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.768439] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.768562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.768837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.768986] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.769149] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port ddd90c87-997d-4666-82ea-248aa4cdac4b not found, creating... [ 616.769401] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.769555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.769666] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.769963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.770088] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.770369] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.770521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.770632] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.770844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.770975] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.771126] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: ddd90c87-997d-4666-82ea-248aa4cdac4b is going to be created. [ 616.799174] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.799472] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.799579] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.799834] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.800078] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.800310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.801283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.801464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.801507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.801653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.801805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.801902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.801965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.802128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.802209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.802294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.802433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.802523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.802583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.802721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.802856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.802945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.803010] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.803155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.803229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.803308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.803395] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.916987] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc61c851-c763-4376-85e6-34d53cea2be7 [ 616.916987] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.916987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.916987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.916987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.916987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.916987] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc61c851-c763-4376-85e6-34d53cea2be7 already deleted. [ 616.916987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc61c851-c763-4376-85e6-34d53cea2be7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.308833] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 617.345331] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.345522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.345577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.345820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.345943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.347438] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.347438] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.347438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.347892] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.347892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.347892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.347892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.348040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.348040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be created. [ 617.461062] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.461489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.461594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.461809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.462018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.480794] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 617.541191] env[65455]: INFO networking_nsxv3.common.synchronization [req-c412ff21-4c6f-48f3-a5e2-0d6137bcbc1e req-b317dea0-325a-4bc4-b4ff-56e02abd0ac9 service nova] Enqueued Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_rules [ 617.541378] env[65455]: INFO networking_nsxv3.common.synchronization [req-c412ff21-4c6f-48f3-a5e2-0d6137bcbc1e req-b317dea0-325a-4bc4-b4ff-56e02abd0ac9 service nova] Enqueued Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 617.541506] env[65455]: INFO networking_nsxv3.common.synchronization [req-c412ff21-4c6f-48f3-a5e2-0d6137bcbc1e req-b317dea0-325a-4bc4-b4ff-56e02abd0ac9 service nova] Enqueued Resource ID: ddd90c87-997d-4666-82ea-248aa4cdac4b with Priority: HIGHEST for action port [ 617.542065] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_rules [ 617.542206] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 617.542307] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddd90c87-997d-4666-82ea-248aa4cdac4b with Priority: HIGHEST for action port [ 617.542578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.542701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.542787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.543371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.543469] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.544774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.544894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.544961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.545179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.545339] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.545437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.545499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.545703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.545768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.545854] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.547084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddd90c87-997d-4666-82ea-248aa4cdac4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.547257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.547257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.547789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.547872] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddd90c87-997d-4666-82ea-248aa4cdac4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.051881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.051881] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.051881] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddd90c87-997d-4666-82ea-248aa4cdac4b with status ACTIVE [ 618.051881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.051881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.051881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.053095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.053210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.053629] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.054404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.054488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.058020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.058020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.058020] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddd90c87-997d-4666-82ea-248aa4cdac4b is going to be updated. [ 618.079861] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.080125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.080125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.080394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.080574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.080734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddd90c87-997d-4666-82ea-248aa4cdac4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.117498] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ccd4e6f7-4946-4c5b-82dd-45b095b73892 None None] Enqueued Resource ID: c5e14b42-8c7e-4026-a168-1793bc0c9365 with Priority: HIGHEST for action port [ 618.118143] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e14b42-8c7e-4026-a168-1793bc0c9365 with Priority: HIGHEST for action port [ 618.118935] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e14b42-8c7e-4026-a168-1793bc0c9365 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.119124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e14b42-8c7e-4026-a168-1793bc0c9365" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.119209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e14b42-8c7e-4026-a168-1793bc0c9365" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.119516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e14b42-8c7e-4026-a168-1793bc0c9365" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.119635] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e14b42-8c7e-4026-a168-1793bc0c9365',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.349046] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 618.349046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.349348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.349640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.349834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.349954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.350029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.350183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.350259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.350342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.350446] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.447200] env[65455]: INFO networking_nsxv3.common.synchronization [req-c1b7a2e1-4cf5-4f63-8105-cbd9640c1d17 req-86850a00-fa56-402d-85a5-5bb5f5e5ab60 tempest-FloatingIPsAssociationTestJSON-414106725 tempest-FloatingIPsAssociationTestJSON-414106725-project-member] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 618.447818] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 618.449033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.449033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.449033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.449033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.449255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.449255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.449366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.449564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.449564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.449659] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.560550] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.621983] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5e14b42-8c7e-4026-a168-1793bc0c9365 [ 618.622307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.622489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.622587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.623286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.623286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.623286] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5e14b42-8c7e-4026-a168-1793bc0c9365 already deleted. [ 618.623286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e14b42-8c7e-4026-a168-1793bc0c9365" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.856146] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.856406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.856548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.856930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.857195] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.857370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.857463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.857798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.857978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.858096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.858288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.858384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.858448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.858620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.859046] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.859186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.859236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.859368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.859461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.859557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.859657] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.951757] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.951959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.952015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.953316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.953441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.953725] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.953816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.953816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.953985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.954074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.954148] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 already deleted. [ 618.954222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.011468] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.011700] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.011893] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.012557] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.012883] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.013067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.013461] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.013461] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.013742] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.013803] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.013917] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.014045] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.014145] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.014275] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.014366] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.014685] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.037044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.037044] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.037292] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.037341] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.037850] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-3d28c85b-bcf6-4222-bcee-78e10f5aef67 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.037850] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.038905] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.038905] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.038905] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d28c85b-bcf6-4222-bcee-78e10f5aef67',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.065779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.066480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.066480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.066480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.066480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.066708] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a is going to be created. [ 619.097530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.097747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.097747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.098066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.098310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.111766] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: UNINITIALIZED for 2s [ 619.362802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfb754e-de2d-4baa-bb6c-0888418311d4: rpc.has_security_group_logging(os_id): False [ 619.384467] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.384689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.384689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.384976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.385090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.385376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.385510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.385581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.385758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.386161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.386161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.386302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.386339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.386478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.386563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.386934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.387033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.387083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.387231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.387313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.387443] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be created. [ 619.455739] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.455739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.455739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.455739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.456043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.470034] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 619.493027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 619.493155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.540852] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.541230] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.541421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.541717] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.541871] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.542040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 3d28c85b-bcf6-4222-bcee-78e10f5aef67 not found, creating... [ 619.542335] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.542488] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.542602] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.542891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.544030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.544030] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.544030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.544030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.544030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.544255] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.544424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 3d28c85b-bcf6-4222-bcee-78e10f5aef67 is going to be created. [ 619.581212] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.581467] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.581586] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.581868] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.582449] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.582742] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.643186] env[65455]: INFO networking_nsxv3.common.synchronization [None req-9c635d64-723a-466a-9489-92f3a5e89b9d tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 619.643383] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 619.643708] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.643841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.643907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.644260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.644355] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.917166] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5db11d2c-3d51-46af-95d9-22f2b12605df None None] Enqueued Resource ID: 8f1ade3c-2d7f-4620-b396-58efd1f05344 with Priority: HIGHEST for action port [ 619.917344] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1ade3c-2d7f-4620-b396-58efd1f05344 with Priority: HIGHEST for action port [ 619.917659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f1ade3c-2d7f-4620-b396-58efd1f05344 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.917808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f1ade3c-2d7f-4620-b396-58efd1f05344" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.917842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f1ade3c-2d7f-4620-b396-58efd1f05344" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.918240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f1ade3c-2d7f-4620-b396-58efd1f05344" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.918339] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1ade3c-2d7f-4620-b396-58efd1f05344',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.019432] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a52779df-aafc-4dda-b0c6-131c3158143a tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 620.021092] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 620.021578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.021759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.165110] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.165533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.165533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.165533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.165632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.165715] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 already deleted. [ 620.165819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.165944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.166452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.166452] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.349326] env[65455]: INFO networking_nsxv3.common.synchronization [req-c1b7a2e1-4cf5-4f63-8105-cbd9640c1d17 req-64578195-08c4-48a0-bfd8-09c2dbc971d1 service nova] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_rules [ 620.349787] env[65455]: INFO networking_nsxv3.common.synchronization [req-c1b7a2e1-4cf5-4f63-8105-cbd9640c1d17 req-64578195-08c4-48a0-bfd8-09c2dbc971d1 service nova] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 620.351019] env[65455]: INFO networking_nsxv3.common.synchronization [req-c1b7a2e1-4cf5-4f63-8105-cbd9640c1d17 req-64578195-08c4-48a0-bfd8-09c2dbc971d1 service nova] Enqueued Resource ID: 3d28c85b-bcf6-4222-bcee-78e10f5aef67 with Priority: HIGHEST for action port [ 620.351019] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_rules [ 620.351019] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 620.352356] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d28c85b-bcf6-4222-bcee-78e10f5aef67 with Priority: HIGHEST for action port [ 620.352356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.352356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.352356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.353210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.353210] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.354316] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.354316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.354486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.354536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.355245] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.355245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.355245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.355245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.355480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.355666] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.357511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d28c85b-bcf6-4222-bcee-78e10f5aef67 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.357511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.357511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.357511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.357866] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d28c85b-bcf6-4222-bcee-78e10f5aef67',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.421715] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f1ade3c-2d7f-4620-b396-58efd1f05344 [ 620.421913] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.422146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.422232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.422430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.422534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.422618] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f1ade3c-2d7f-4620-b396-58efd1f05344 already deleted. [ 620.422686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f1ade3c-2d7f-4620-b396-58efd1f05344" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.687977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.688213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.688296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.688570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.688707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.688853] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 already deleted. [ 620.689047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.735146] env[65455]: INFO networking_nsxv3.common.synchronization [req-6f7585ad-f2a4-4d3c-bd51-7808e1bda1fc req-f8947c84-aa3c-4c87-a68b-b8b58d6c1c7a tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 620.735678] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 620.736114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.736114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.736233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.736361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.736505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.736636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.736729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.736887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.737008] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.738192] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.859718] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.860079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.863829] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.865741] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d28c85b-bcf6-4222-bcee-78e10f5aef67 with status ACTIVE [ 620.865741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.865741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.865741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.868050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.868431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.870043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.870043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.870043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.871377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.871970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.872164] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.873297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.873297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.873297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.873297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.873297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d28c85b-bcf6-4222-bcee-78e10f5aef67 is going to be updated. [ 620.897646] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.898442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.898442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.898442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.898660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.899609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d28c85b-bcf6-4222-bcee-78e10f5aef67" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.125796] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: SUCCESS [ 621.125796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.125946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.126250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.126562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.126919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.127073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.127334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.127445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.127548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.128115] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.223677] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.224023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.224097] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.224351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.224688] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.224946] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.225131] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.225482] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.225683] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.225981] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.226264] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.226516] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.226583] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.226815] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.226930] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.227072] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.241275] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.246929] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.247098] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.247221] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.247396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.247702] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-96cb48d4-afc1-41e2-bbe9-5d74b849029e taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.247875] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.248117] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.248448] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.248595] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96cb48d4-afc1-41e2-bbe9-5d74b849029e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.375294] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.486511] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 621.486872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.629984] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.630216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.630295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.630586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.630783] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.630887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.630950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.631143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.631231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.631317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.631462] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.631554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.631616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.631763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.631923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.632023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.632073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.632221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.632301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.632383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.632473] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.743902] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.751374] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.751669] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.751856] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.752262] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.752481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.752698] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 96cb48d4-afc1-41e2-bbe9-5d74b849029e not found, creating... [ 621.753284] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.753389] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.753503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.753870] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.754283] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.754726] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.755037] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.755137] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.755446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.755675] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.755923] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 96cb48d4-afc1-41e2-bbe9-5d74b849029e is going to be created. [ 621.779963] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.779963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.779963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.779963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.779963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.779963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.878092] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.880211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.880211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.881820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.881820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.881820] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be created. [ 621.933126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.935727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.935895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.936158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.936337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.950053] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: UNINITIALIZED for 2s [ 622.135070] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 070a53e6-caa7-4afa-8d02-177f2d45739a: rpc.has_security_group_logging(os_id): False [ 622.153346] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.153466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.153466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.153692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.153791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.153999] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.154113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.154186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.154344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.154423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.154606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.154757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.154757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.154899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.154971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.155168] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.155260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.155311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.155455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.155530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.155614] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a is going to be created. [ 622.202207] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c8501187-af8e-4980-a897-99a7ad4adfb7 None None] Enqueued Resource ID: ed0cce82-e1f1-43cd-86a2-10910e229f54 with Priority: HIGHEST for action port [ 622.202724] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed0cce82-e1f1-43cd-86a2-10910e229f54 with Priority: HIGHEST for action port [ 622.203034] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed0cce82-e1f1-43cd-86a2-10910e229f54 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.203199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed0cce82-e1f1-43cd-86a2-10910e229f54" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.203249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed0cce82-e1f1-43cd-86a2-10910e229f54" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.203640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed0cce82-e1f1-43cd-86a2-10910e229f54" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.203828] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed0cce82-e1f1-43cd-86a2-10910e229f54',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.211962] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.212111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.212186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.212887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.212887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.225715] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: IN_PROGRESS for 2s [ 622.248504] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.248715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.248715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.250241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.250241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.250241] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 622.332674] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.332843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.332917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.333167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.333311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.344733] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 622.498044] env[65455]: INFO networking_nsxv3.common.synchronization [req-6f7585ad-f2a4-4d3c-bd51-7808e1bda1fc req-f0bb10b1-df4d-4ffd-abb6-1b91270db626 service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 622.498285] env[65455]: INFO networking_nsxv3.common.synchronization [req-6f7585ad-f2a4-4d3c-bd51-7808e1bda1fc req-f0bb10b1-df4d-4ffd-abb6-1b91270db626 service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 622.498453] env[65455]: INFO networking_nsxv3.common.synchronization [req-6f7585ad-f2a4-4d3c-bd51-7808e1bda1fc req-f0bb10b1-df4d-4ffd-abb6-1b91270db626 service nova] Enqueued Resource ID: 96cb48d4-afc1-41e2-bbe9-5d74b849029e with Priority: HIGHEST for action port [ 622.498898] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 622.499585] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 622.499755] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96cb48d4-afc1-41e2-bbe9-5d74b849029e with Priority: HIGHEST for action port [ 622.500058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.500324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.500324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.500471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.500562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.501737] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.501809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.501994] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-96cb48d4-afc1-41e2-bbe9-5d74b849029e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.502146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.502292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.502531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.502653] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96cb48d4-afc1-41e2-bbe9-5d74b849029e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.585395] env[65455]: INFO networking_nsxv3.common.synchronization [None req-bef7a16a-8aaa-472f-afe2-34db686baae9 None None] Enqueued Resource ID: 200bbeaf-46d4-450e-97dc-a7c0cd78c7b6 with Priority: HIGHEST for action port [ 622.585395] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200bbeaf-46d4-450e-97dc-a7c0cd78c7b6 with Priority: HIGHEST for action port [ 622.585395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-200bbeaf-46d4-450e-97dc-a7c0cd78c7b6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.585545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-200bbeaf-46d4-450e-97dc-a7c0cd78c7b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.585586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-200bbeaf-46d4-450e-97dc-a7c0cd78c7b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.585814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-200bbeaf-46d4-450e-97dc-a7c0cd78c7b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.585893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200bbeaf-46d4-450e-97dc-a7c0cd78c7b6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.705568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed0cce82-e1f1-43cd-86a2-10910e229f54 [ 622.705755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.705896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.705992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.706260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.706367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.706514] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed0cce82-e1f1-43cd-86a2-10910e229f54 already deleted. [ 622.706687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed0cce82-e1f1-43cd-86a2-10910e229f54" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.005551] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.007507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.007507] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96cb48d4-afc1-41e2-bbe9-5d74b849029e with status ACTIVE [ 623.007507] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.007507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.007507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.008225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.008354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.008648] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.008780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.008895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.009160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.009256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.010676] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.010924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.011072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.011339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.011474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.011593] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96cb48d4-afc1-41e2-bbe9-5d74b849029e is going to be updated. [ 623.043698] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.043698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.043698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.043698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.043698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.043951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96cb48d4-afc1-41e2-bbe9-5d74b849029e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.088755] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 200bbeaf-46d4-450e-97dc-a7c0cd78c7b6 [ 623.089095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.089200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.089200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.089518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.089630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.089901] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:200bbeaf-46d4-450e-97dc-a7c0cd78c7b6 already deleted. [ 623.090061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-200bbeaf-46d4-450e-97dc-a7c0cd78c7b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.968155] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.968155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.968155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.968155] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.244279] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: SUCCESS [ 624.244279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.360351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 624.363210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.363498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.363827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.364110] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.364287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.364374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.364615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.364732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.364865] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.471491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.471719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.471765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.472227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.472288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.472434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.472503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.472695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.472846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.473306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.473306] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.473306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.473306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.473576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.473703] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.473860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.473933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.475077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.475781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.475781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.475781] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.867978] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.979447] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d1eda5c-438c-423f-9e82-2cec12b4ecd8: rpc.has_security_group_logging(os_id): False [ 625.018343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.018551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.018926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.021158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.021158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.023758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.023758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.023758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.023758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.023758] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be created. [ 625.094315] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.094521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.094610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.094862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.095066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.112986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 625.370875] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.502356] env[65455]: INFO networking_nsxv3.common.synchronization [None req-47f31f81-c5aa-4f4a-ad09-7f5f96bc0db6 None None] Enqueued Resource ID: 6005b5c0-3bb4-4b32-ae2a-42f1457fafb0 with Priority: HIGHEST for action port [ 625.508102] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6005b5c0-3bb4-4b32-ae2a-42f1457fafb0 with Priority: HIGHEST for action port [ 625.508102] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6005b5c0-3bb4-4b32-ae2a-42f1457fafb0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.508102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6005b5c0-3bb4-4b32-ae2a-42f1457fafb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.508102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6005b5c0-3bb4-4b32-ae2a-42f1457fafb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.508102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6005b5c0-3bb4-4b32-ae2a-42f1457fafb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.508102] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6005b5c0-3bb4-4b32-ae2a-42f1457fafb0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.599731] env[65455]: INFO networking_nsxv3.common.synchronization [req-e9779624-8f28-4cad-9868-d41fa5c91994 req-bf6d1699-d70e-45bf-bba5-1f63af79f30d tempest-VolumesAssistedSnapshotsTest-1816646194 tempest-VolumesAssistedSnapshotsTest-1816646194-project-member] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 625.601829] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 625.601964] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.602075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.602121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.602395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.602571] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.602691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.602765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.602884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.602967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.603068] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.874617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.874617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.874617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.874771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.875222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.875222] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 625.912021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.912021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.921849] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 626.008692] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6005b5c0-3bb4-4b32-ae2a-42f1457fafb0 [ 626.009050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.009181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.009181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.010641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.010641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.010641] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6005b5c0-3bb4-4b32-ae2a-42f1457fafb0 already deleted. [ 626.010641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6005b5c0-3bb4-4b32-ae2a-42f1457fafb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.040408] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-753 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.040599] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-753" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.040766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-753" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.041143] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-753" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.041431] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.041643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.041761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.042042] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.042257] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.042606] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.042684] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.042842] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.042919] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.043043] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.043151] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.043307] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.065469] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.066041] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.066041] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.066223] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-753" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.066996] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-334fe23a-45d5-44d9-a95d-8db43e71675b taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.066996] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.066996] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.067317] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.067490] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334fe23a-45d5-44d9-a95d-8db43e71675b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.106417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.106511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.106681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.106954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.107128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.107265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.107396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.107478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.107655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.107744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.107830] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 already deleted. [ 626.107915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.570332] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.570616] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.570699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.571011] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.571153] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.571301] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 334fe23a-45d5-44d9-a95d-8db43e71675b not found, creating... [ 626.571923] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.571923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.571923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.572169] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.572169] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.572427] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.572573] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.572693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.572893] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.573586] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.573586] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 334fe23a-45d5-44d9-a95d-8db43e71675b is going to be created. [ 626.594697] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.594880] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.595157] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.595699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.596156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.596407] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.131532] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 627.131866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [req-e9779624-8f28-4cad-9868-d41fa5c91994 req-a800a378-ca16-49b8-8db5-5a39524572ea service nova] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [req-e9779624-8f28-4cad-9868-d41fa5c91994 req-a800a378-ca16-49b8-8db5-5a39524572ea service nova] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [req-e9779624-8f28-4cad-9868-d41fa5c91994 req-a800a378-ca16-49b8-8db5-5a39524572ea service nova] Enqueued Resource ID: 334fe23a-45d5-44d9-a95d-8db43e71675b with Priority: HIGHEST for action port [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_rules [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 627.362526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334fe23a-45d5-44d9-a95d-8db43e71675b with Priority: HIGHEST for action port [ 627.362526] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.362526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.362526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.362526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.363252] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.364847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.365217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.365398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.365738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.366023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.366552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.366751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.367040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.367273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.367569] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.368861] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-334fe23a-45d5-44d9-a95d-8db43e71675b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.369119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.371639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.371639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.371639] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334fe23a-45d5-44d9-a95d-8db43e71675b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.875534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.875534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875534] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.875534] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 334fe23a-45d5-44d9-a95d-8db43e71675b with status ACTIVE [ 627.875534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.875782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.875782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.875897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.876271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.882484] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.882484] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.882484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.882484] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 334fe23a-45d5-44d9-a95d-8db43e71675b is going to be updated. [ 627.912017] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.912516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.912516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.913012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.913242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.913492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334fe23a-45d5-44d9-a95d-8db43e71675b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.936411] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 627.936827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.938152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.939343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.939718] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.939889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.939981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.940232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.940376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.940502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.940623] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.124929] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb52e62d-4f4a-469f-a63a-3de0304f251c req-20a2ee6b-3b67-4512-a92e-2e2612d6e56e tempest-DeleteServersAdminTestJSON-396677630 tempest-DeleteServersAdminTestJSON-396677630-project-admin] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 628.125395] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 628.125719] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.125854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.125926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.126949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.127253] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.127381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.127450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.127701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.127790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.127879] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.382776] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.445839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.445839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.445839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.445839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.445839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.447511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.447511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.447511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.447511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.447511] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.630718] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.631015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.631015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.631217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.634025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.634025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.634025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.634025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.634025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.634025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.634025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be updated. [ 628.661570] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.661570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.661823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.661954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.662118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.675841] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 628.734033] env[65455]: INFO networking_nsxv3.common.synchronization [req-40074f7c-0089-401a-8625-fb8e419ae887 req-d73ea93e-7351-4c9d-b756-8da2d47678d5 tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 628.734033] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 628.734033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.734033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.734033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.734033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.735350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.735350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.735350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.735659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.735659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.735808] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.886788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.889037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.889037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.889037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.889037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.889037] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 is going to be created. [ 628.915403] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.915403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.915403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.915796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.915796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.930061] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: UNINITIALIZED for 2s [ 628.951576] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfb754e-de2d-4baa-bb6c-0888418311d4: rpc.has_security_group_logging(os_id): False [ 628.974022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.975983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.975983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.976464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.976664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.976764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.976820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.976940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.977034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.977215] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.977359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.977359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.977759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.977759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.977759] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 629.063652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.063751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.063751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.064255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.064255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.085725] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 629.116698] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e3fbebad-9668-40fb-969b-9ea5c43158dd None None] Enqueued Resource ID: 51fd9d30-00e5-4a2e-8034-5861b3af2921 with Priority: HIGHEST for action port [ 629.116878] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51fd9d30-00e5-4a2e-8034-5861b3af2921 with Priority: HIGHEST for action port [ 629.118113] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-51fd9d30-00e5-4a2e-8034-5861b3af2921 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.118256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51fd9d30-00e5-4a2e-8034-5861b3af2921" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.118413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51fd9d30-00e5-4a2e-8034-5861b3af2921" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.120849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51fd9d30-00e5-4a2e-8034-5861b3af2921" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.124334] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51fd9d30-00e5-4a2e-8034-5861b3af2921',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.149112] env[65455]: INFO networking_nsxv3.common.synchronization [req-93d89edc-8be2-4c4c-aa27-805de5884fc2 req-1b5ef63c-c286-4849-957b-627c3cfcff35 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 629.149734] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 629.150296] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.150482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.150541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.150764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.150965] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.151192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.151192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.151346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.152013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.152013] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.241295] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.551299] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-929 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.551299] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.551299] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.551299] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.552315] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.552823] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.556027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.556027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.556027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.556027] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.556027] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.556027] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.556027] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.556027] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.556027] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.556027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.578608] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.578608] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.579678] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.579678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-929" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.581171] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-6ee14490-e283-41f3-9e69-0b15a8b6495e taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.581171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.581171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.581171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.581171] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee14490-e283-41f3-9e69-0b15a8b6495e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.628283] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51fd9d30-00e5-4a2e-8034-5861b3af2921 [ 629.631283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.631283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.631283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.631283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.631283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.631283] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51fd9d30-00e5-4a2e-8034-5861b3af2921 already deleted. [ 629.631283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51fd9d30-00e5-4a2e-8034-5861b3af2921" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.655385] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.655385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.655385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.655611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.655611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.655761] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.655873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.655936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.656153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.656241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.656331] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 629.697074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.697074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.697074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.697074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.697074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.707887] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 629.743656] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.086579] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.086837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.086960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.087275] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.087421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.088388] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 6ee14490-e283-41f3-9e69-0b15a8b6495e not found, creating... [ 630.088388] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.088388] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.088388] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.088388] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.088807] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.088807] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.089899] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.089899] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.089977] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.090130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.090278] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 6ee14490-e283-41f3-9e69-0b15a8b6495e is going to be created. [ 630.115208] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.115475] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.115556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.115881] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.116152] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.116432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.247332] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.251713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.251713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.251876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.252207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.252207] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 630.305920] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.306090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.306158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.306385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.306754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.322636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 630.623099] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e462f64c-2a98-4ff8-9aa6-611fcbd0c1c1 None None] Enqueued Resource ID: b2d4960f-ac40-4f74-ba37-7f42e0277639 with Priority: HIGHEST for action port [ 630.623752] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d4960f-ac40-4f74-ba37-7f42e0277639 with Priority: HIGHEST for action port [ 630.625084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2d4960f-ac40-4f74-ba37-7f42e0277639 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.625561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2d4960f-ac40-4f74-ba37-7f42e0277639" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.625561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2d4960f-ac40-4f74-ba37-7f42e0277639" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.627112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2d4960f-ac40-4f74-ba37-7f42e0277639" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.627285] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2d4960f-ac40-4f74-ba37-7f42e0277639',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.690612] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 630.692259] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 deletion is rescheduled due to dependency. [ 630.692453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.885302] env[65455]: INFO networking_nsxv3.common.synchronization [req-40074f7c-0089-401a-8625-fb8e419ae887 req-82a3f9a4-4b30-46a2-b50f-91a6a4ca96ab service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 630.885550] env[65455]: INFO networking_nsxv3.common.synchronization [req-40074f7c-0089-401a-8625-fb8e419ae887 req-82a3f9a4-4b30-46a2-b50f-91a6a4ca96ab service nova] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 630.885637] env[65455]: INFO networking_nsxv3.common.synchronization [req-40074f7c-0089-401a-8625-fb8e419ae887 req-82a3f9a4-4b30-46a2-b50f-91a6a4ca96ab service nova] Enqueued Resource ID: 6ee14490-e283-41f3-9e69-0b15a8b6495e with Priority: HIGHEST for action port [ 630.886207] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_rules [ 630.886694] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 630.886812] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ee14490-e283-41f3-9e69-0b15a8b6495e with Priority: HIGHEST for action port [ 630.887122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.887210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.887446] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.887508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.887666] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ee14490-e283-41f3-9e69-0b15a8b6495e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.887876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.887876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.888049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.888122] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee14490-e283-41f3-9e69-0b15a8b6495e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.942704] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: SUCCESS [ 630.943523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.944024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.944262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.944302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.944439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.944516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.944734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.944734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.944878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.944933] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.100592] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 631.100661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.101213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.101213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.101213] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.130962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2d4960f-ac40-4f74-ba37-7f42e0277639 [ 631.130962] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.130962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.130962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.130962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.130962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.131228] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2d4960f-ac40-4f74-ba37-7f42e0277639 already deleted. [ 631.131228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2d4960f-ac40-4f74-ba37-7f42e0277639" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.390217] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ee14490-e283-41f3-9e69-0b15a8b6495e with status ACTIVE [ 631.390217] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.390440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.390440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.390678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.390806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.391173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.391173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.391276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.391363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.392868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.392868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.392868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.392868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.392868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.392868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.392868] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ee14490-e283-41f3-9e69-0b15a8b6495e is going to be updated. [ 631.400743] env[65455]: INFO networking_nsxv3.common.synchronization [req-8e61f395-de00-44f8-8fa5-93b3300fe431 req-95c98409-39cf-4ca3-beda-ec153ef5490c tempest-ImagesNegativeTestJSON-1239426278 tempest-ImagesNegativeTestJSON-1239426278-project-member] Enqueued Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 631.400743] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 631.400743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.400743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.400743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.400743] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.421291] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.421455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.421520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.421989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.421989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.422150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ee14490-e283-41f3-9e69-0b15a8b6495e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.447786] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.604329] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.604329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.725038] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 631.725038] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 631.725038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.824035] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5c9ccb8d-88a1-414e-9b34-7b5062b23b53 None None] Enqueued Resource ID: b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea with Priority: HIGHEST for action port [ 631.825483] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea with Priority: HIGHEST for action port [ 631.825483] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.825708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.825818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.826193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.826308] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.868451] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-687 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.868682] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-687" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.868853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-687" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.869128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-687" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.869391] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.869550] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.869666] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.869893] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.870773] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.870773] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.870773] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.870773] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.870773] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.870773] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.871040] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.871040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.892651] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.892896] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.893381] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.893703] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-687" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.893920] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-d7717fec-3e74-46d2-b721-7487aec957d9 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.894115] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.894238] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.894651] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.894987] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7717fec-3e74-46d2-b721-7487aec957d9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.905469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.905881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.906043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.906293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.906418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.907611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.907760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.908233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.908475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.908597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.908715] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 already deleted. [ 631.908849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.951935] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07680d19-56f1-4d34-ab9f-26b0ad63d370: rpc.has_security_group_logging(os_id): False [ 631.972300] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.972450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.972511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.972805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.972875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.973089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.973195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.973256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.973447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.973854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.973854] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 is going to be created. [ 632.048377] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.048615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.048615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.048866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.049129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.066057] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: IN_PROGRESS for 2s [ 632.328970] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea [ 632.329403] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.329680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.329680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.329905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.329983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.330161] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea already deleted. [ 632.330362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2ede7f4-0985-4dc5-a033-4dc5c2fa61ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.354790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 632.354790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.354790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.354790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.355135] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.355135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.355135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.355371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.355523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.356661] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.399081] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.399316] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.399316] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.399849] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.399849] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.400101] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port d7717fec-3e74-46d2-b721-7487aec957d9 not found, creating... [ 632.400278] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.400442] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.400556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.400793] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.400983] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.401321] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.401479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.401617] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.401941] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.402102] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.402243] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: d7717fec-3e74-46d2-b721-7487aec957d9 is going to be created. [ 632.428727] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.428955] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.429060] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.429468] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.429582] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.429821] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.492895] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ae0802f3-f29f-4bcc-a5d1-a95b9c7e9dc5 None None] Enqueued Resource ID: 866800c8-6f05-4220-b339-ac0ec1cb0ecf with Priority: HIGHEST for action port [ 632.492895] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 866800c8-6f05-4220-b339-ac0ec1cb0ecf with Priority: HIGHEST for action port [ 632.492895] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-866800c8-6f05-4220-b339-ac0ec1cb0ecf taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.492895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-866800c8-6f05-4220-b339-ac0ec1cb0ecf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.492895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-866800c8-6f05-4220-b339-ac0ec1cb0ecf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.492895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-866800c8-6f05-4220-b339-ac0ec1cb0ecf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.492895] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866800c8-6f05-4220-b339-ac0ec1cb0ecf',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.859670] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.996041] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 866800c8-6f05-4220-b339-ac0ec1cb0ecf [ 632.996041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.996041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.996041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.997762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.997762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.997762] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:866800c8-6f05-4220-b339-ac0ec1cb0ecf already deleted. [ 632.997762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-866800c8-6f05-4220-b339-ac0ec1cb0ecf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.241200] env[65455]: INFO networking_nsxv3.common.synchronization [req-8e61f395-de00-44f8-8fa5-93b3300fe431 req-73ea6638-ef1b-4bb7-b855-b48ec90e7f7f service nova] Enqueued Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_rules [ 633.241200] env[65455]: INFO networking_nsxv3.common.synchronization [req-8e61f395-de00-44f8-8fa5-93b3300fe431 req-73ea6638-ef1b-4bb7-b855-b48ec90e7f7f service nova] Enqueued Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 633.241200] env[65455]: INFO networking_nsxv3.common.synchronization [req-8e61f395-de00-44f8-8fa5-93b3300fe431 req-73ea6638-ef1b-4bb7-b855-b48ec90e7f7f service nova] Enqueued Resource ID: d7717fec-3e74-46d2-b721-7487aec957d9 with Priority: HIGHEST for action port [ 633.241200] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_rules [ 633.241200] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 633.241395] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7717fec-3e74-46d2-b721-7487aec957d9 with Priority: HIGHEST for action port [ 633.241688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.241904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.241974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.242266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.242371] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.243530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.243648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.243723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.244020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.244361] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.246109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.246109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.246109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.246109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.246109] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.246109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7717fec-3e74-46d2-b721-7487aec957d9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.246653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.246653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.246653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.246653] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7717fec-3e74-46d2-b721-7487aec957d9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.362292] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.655340] env[65455]: INFO networking_nsxv3.common.synchronization [req-b452f25c-b552-463a-9042-8410bb781a80 req-e8a5e869-41e7-4ee5-9c76-1017139302bf tempest-ServersTestFqdnHostnames-1791544921 tempest-ServersTestFqdnHostnames-1791544921-project-member] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 633.655340] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 633.655950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.658536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.658745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.659141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.659442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.659682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.659905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.660175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.660369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.660558] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.748873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.749029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.749209] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.750319] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7717fec-3e74-46d2-b721-7487aec957d9 with status ACTIVE [ 633.750541] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.750610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.750658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.750897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.750988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.751153] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.751245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.751348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.751545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.751545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.751747] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.751818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.751851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.751976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.752658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.752771] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7717fec-3e74-46d2-b721-7487aec957d9 is going to be updated. [ 633.776938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.776938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.776938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.776938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.776938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.776938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7717fec-3e74-46d2-b721-7487aec957d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.867562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.867562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.867562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.867562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.867562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.867562] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 633.926122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.926299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.926342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.926749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.926899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.939857] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 634.046795] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.046795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-139" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.046995] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-139" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.047816] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-139" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.047913] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.048125] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.048478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.048478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.048602] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.048842] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.049102] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.049267] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.049330] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.049484] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.049893] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.049893] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.071902] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.071902] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.071902] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.071902] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-139" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.072994] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-d6f4d03f-3c7e-443f-a79e-933079618ca3 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.072994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.072994] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.073324] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.073389] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6f4d03f-3c7e-443f-a79e-933079618ca3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.081891] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: SUCCESS [ 634.082139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.163537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.163686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.163810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.164079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.165123] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.165123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ec5c2d-0701-464f-b730-022584dac61b already deleted. [ 634.165123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.256346] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.582126] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.582126] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.582126] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.582360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.582410] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.582583] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port d6f4d03f-3c7e-443f-a79e-933079618ca3 not found, creating... [ 634.582886] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.583098] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.583225] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.583466] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.583611] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.583923] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.588021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.588021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.588021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.588021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.588021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: d6f4d03f-3c7e-443f-a79e-933079618ca3 is going to be created. [ 634.611972] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.612384] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.612384] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.613354] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.613354] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.613354] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.760337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.760337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.760337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.760337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.760337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.760337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 is going to be created. [ 634.809455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.810942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.811169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.811542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.815251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.828100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: UNINITIALIZED for 2s [ 635.436327] env[65455]: INFO networking_nsxv3.common.synchronization [req-b452f25c-b552-463a-9042-8410bb781a80 req-9310ee57-7341-45b0-94af-829bccbca1bb service nova] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 635.436779] env[65455]: INFO networking_nsxv3.common.synchronization [req-b452f25c-b552-463a-9042-8410bb781a80 req-9310ee57-7341-45b0-94af-829bccbca1bb service nova] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 635.436779] env[65455]: INFO networking_nsxv3.common.synchronization [req-b452f25c-b552-463a-9042-8410bb781a80 req-9310ee57-7341-45b0-94af-829bccbca1bb service nova] Enqueued Resource ID: d6f4d03f-3c7e-443f-a79e-933079618ca3 with Priority: HIGHEST for action port [ 635.441784] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_rules [ 635.441784] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 635.442302] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6f4d03f-3c7e-443f-a79e-933079618ca3 with Priority: HIGHEST for action port [ 635.442302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.442302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.442441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.442597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.442680] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.444064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.444223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.444284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.444531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.444616] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.444720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.444780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.444977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.446248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.446248] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.450835] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6f4d03f-3c7e-443f-a79e-933079618ca3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.450835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.450835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.450835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.450835] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6f4d03f-3c7e-443f-a79e-933079618ca3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.647758] env[65455]: INFO networking_nsxv3.common.synchronization [req-df41e62b-09bc-43ac-980a-ea6f1d06a1ec req-db50d638-7bec-4620-b909-0da84617e8fa tempest-FloatingIPsAssociationNegativeTestJSON-2086781852 tempest-FloatingIPsAssociationNegativeTestJSON-2086781852-project-member] Enqueued Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 635.648334] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 635.648713] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.648998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.649421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.649891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.650100] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.650249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.650311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.650468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.650574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.650715] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.950672] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 635.950954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.951161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.951390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.951581] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.951706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.952037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.952037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.952037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.952240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.952240] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.953202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.953325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.953460] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.954457] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6f4d03f-3c7e-443f-a79e-933079618ca3 with status ACTIVE [ 635.954571] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.954724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.954794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.954940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.955047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.955233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.955338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.955394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.955546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.955854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.955854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.955938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.955982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.956142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.956215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.956297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6f4d03f-3c7e-443f-a79e-933079618ca3 is going to be updated. [ 635.979430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.979537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.979537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.979757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.979899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.980183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6f4d03f-3c7e-443f-a79e-933079618ca3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.982062] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.982236] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.982351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.982676] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.982936] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.983126] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.983212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.983419] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.983607] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.983826] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.983933] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.984045] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.984150] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.984260] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.984356] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.984465] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.007078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.007274] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.007493] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.008348] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.008348] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.008348] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.008571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.009044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.009175] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2925eec-53e3-4c85-9464-75fdd3f5a6dd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.152811] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.153073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.153173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.153466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.153641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.153928] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.154104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.154201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.154421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.154513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.154607] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad already deleted. [ 636.154727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.455204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.455612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.455612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.455711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.455833] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.455937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.456018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.456217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.456309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.456401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.456588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.456685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.456745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.456892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.457038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.457140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.457277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.457334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.457502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.457502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.457657] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.458538] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.512084] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.512356] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.512495] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.512890] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.513157] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.513675] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port a2925eec-53e3-4c85-9464-75fdd3f5a6dd not found, creating... [ 636.514058] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.514445] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.514674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.515208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.515208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.516234] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.516234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.516234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.516577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.516717] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.516962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: a2925eec-53e3-4c85-9464-75fdd3f5a6dd is going to be created. [ 636.545930] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.545930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.545930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.545930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.545930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.545930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.840260] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: SUCCESS [ 636.840506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.840687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.841043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.841150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.841233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.841295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.841451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.841535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.841658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.841767] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.960819] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfb754e-de2d-4baa-bb6c-0888418311d4: rpc.has_security_group_logging(os_id): False [ 636.962455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.962622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.962709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.962990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.963122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.963247] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ec5c2d-0701-464f-b730-022584dac61b is going to be created. [ 636.989805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.991575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.991689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.991926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.992038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.992283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.992397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.992499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.992739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.992852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.993114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.993227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.993327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.993491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.993605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.993809] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.993955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.994028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.994180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.994256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.994445] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 637.000670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.000823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.000875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.001272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.001439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.050212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: UNINITIALIZED for 2s [ 637.146029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.146029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.146029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.146029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.146029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.168825] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 637.345982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.345982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.345982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.346597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.346597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.346597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.346597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.346792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.347033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.347033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.347666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.347792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.347914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.348066] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.410278] env[65455]: INFO networking_nsxv3.common.synchronization [req-df41e62b-09bc-43ac-980a-ea6f1d06a1ec req-2d7ca18d-9370-461e-aac4-1547c5aa19e4 service nova] Enqueued Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_rules [ 637.411064] env[65455]: INFO networking_nsxv3.common.synchronization [req-df41e62b-09bc-43ac-980a-ea6f1d06a1ec req-2d7ca18d-9370-461e-aac4-1547c5aa19e4 service nova] Enqueued Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 637.411064] env[65455]: INFO networking_nsxv3.common.synchronization [req-df41e62b-09bc-43ac-980a-ea6f1d06a1ec req-2d7ca18d-9370-461e-aac4-1547c5aa19e4 service nova] Enqueued Resource ID: a2925eec-53e3-4c85-9464-75fdd3f5a6dd with Priority: HIGHEST for action port [ 637.411562] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_rules [ 637.412258] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 637.412258] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2925eec-53e3-4c85-9464-75fdd3f5a6dd with Priority: HIGHEST for action port [ 637.412258] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.412628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.412628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.412962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.413133] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.414265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.414398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.414464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.414728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.415037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.415177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.415269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.415443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.415533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.415629] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.416932] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.416932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.416932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.417211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.417211] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2925eec-53e3-4c85-9464-75fdd3f5a6dd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.851209] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17: rpc.has_security_group_logging(os_id): False [ 637.874371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.874371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.874371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.874851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.874851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.875106] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.875618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.875699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.876807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.876888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.877175] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.877286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.877504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.877546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.877665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.877799] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 is going to be created. [ 637.921045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.921191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.921478] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.924347] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2925eec-53e3-4c85-9464-75fdd3f5a6dd with status ACTIVE [ 637.924829] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.926496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.926496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.926496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.926496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.927075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.927385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.927385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.933042] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.933042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.933042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2925eec-53e3-4c85-9464-75fdd3f5a6dd is going to be updated. [ 637.961508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.961792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.962319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.963519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.963698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.963937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2925eec-53e3-4c85-9464-75fdd3f5a6dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.983838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.984081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.984131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.984368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.984650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.004100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: IN_PROGRESS for 2s [ 638.425548] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.932659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.932659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.932659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.932659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.932659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.932659] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad is going to be created. [ 638.959770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.959770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.959770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.959770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.960017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.974351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: UNINITIALIZED for 2s [ 639.069028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: SUCCESS [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.069028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.069028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.069028] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.188420] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 639.188420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.572779] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.023496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: SUCCESS [ 640.023771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.076536] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57ec5c2d-0701-464f-b730-022584dac61b: rpc.has_security_group_logging(os_id): False [ 640.096617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.096872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.096993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.097266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.097367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.097666] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.098558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.098658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.100703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.100703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.100703] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ec5c2d-0701-464f-b730-022584dac61b is going to be created. [ 640.167239] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.167423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.167423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.167724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.168128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.199960] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: IN_PROGRESS for 2s [ 640.994472] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: SUCCESS [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.994472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.994472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.995052] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.044871] env[65455]: INFO networking_nsxv3.common.synchronization [req-92ba515f-b80e-4573-9250-d1e0db85e49b req-94f97203-64f0-4fa0-bee1-246240383791 tempest-InstanceActionsV221TestJSON-1232867568 tempest-InstanceActionsV221TestJSON-1232867568-project-member] Enqueued Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 641.045670] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGHEST for action security_group_members [ 641.045769] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.045849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.045912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.048258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.048386] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.048446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.048555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.048694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.048782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.048879] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.498460] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.498460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.498460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.498742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.499492] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.499492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.499492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.499492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.499492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.501115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.501115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.501115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.501115] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.553123] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.553862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.553862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.553862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.553862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.554096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.554096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.554096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.554261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.554310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.554369] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a is going to be updated. [ 641.585530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.585773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.585850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.587481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.587481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.598787] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: IN_PROGRESS for 2s [ 642.003043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a198777-edb2-486c-96fc-27aa5daf59ad: rpc.has_security_group_logging(os_id): False [ 642.037026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.037026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.037026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.037026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.038092] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.038092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.038582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.038582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.042482] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad is going to be created. [ 642.108398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.108841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.108841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.108841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.110052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.127414] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: IN_PROGRESS for 2s [ 642.226317] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: SUCCESS [ 642.226859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.879822] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0dca14cf-7e2c-4a20-a263-2f448b3d1ad6 None None] Enqueued Resource ID: 0e50861a-29d1-4e61-a1ea-c43366e258e8 with Priority: HIGHEST for action port [ 642.881239] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e50861a-29d1-4e61-a1ea-c43366e258e8 with Priority: HIGHEST for action port [ 642.881427] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e50861a-29d1-4e61-a1ea-c43366e258e8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.881575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e50861a-29d1-4e61-a1ea-c43366e258e8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.881659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e50861a-29d1-4e61-a1ea-c43366e258e8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.881947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e50861a-29d1-4e61-a1ea-c43366e258e8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.882027] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e50861a-29d1-4e61-a1ea-c43366e258e8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.958410] env[65455]: INFO networking_nsxv3.common.synchronization [req-103789fa-bc21-45a0-8432-ddffb053327b req-410149df-2c9d-4ae0-bddc-d3c21602c452 tempest-TenantUsagesTestJSON-1707294520 tempest-TenantUsagesTestJSON-1707294520-project-member] Enqueued Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 642.959878] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 642.960622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.960622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.960801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.961134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.961914] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.961914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.961914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.961914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.962321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.962376] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.386473] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e50861a-29d1-4e61-a1ea-c43366e258e8 [ 643.386473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.386473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.386473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.386473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.386473] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e50861a-29d1-4e61-a1ea-c43366e258e8 already deleted. [ 643.386473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e50861a-29d1-4e61-a1ea-c43366e258e8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.467590] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.467680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.467876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.467958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.468062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.468263] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.468360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.468424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.468577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.468653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.468734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 already deleted. [ 643.468815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.510081] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.510279] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.510404] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.510669] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.510915] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.511111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.511201] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.511396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.511535] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.511864] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.511864] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.512019] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.512076] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.512136] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.512237] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.512359] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.533261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.533414] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.533566] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.533722] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.534046] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-3604483d-5d0b-43c1-8b6f-c5443da0c789 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.534222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.534332] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.534783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.534921] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3604483d-5d0b-43c1-8b6f-c5443da0c789',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.608722] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 070a53e6-caa7-4afa-8d02-177f2d45739a in Status: SUCCESS [ 643.608906] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a deletion is rescheduled due to dependency. [ 643.609038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.038184] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.038417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.038541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.038901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.039119] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.039265] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 3604483d-5d0b-43c1-8b6f-c5443da0c789 not found, creating... [ 644.039529] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.039689] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.039819] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.040064] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.040203] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.040477] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.040633] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.040746] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.040952] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.041379] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.041379] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 3604483d-5d0b-43c1-8b6f-c5443da0c789 is going to be created. [ 644.064302] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.064591] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.064901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.064901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.065260] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.065544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.145253] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: SUCCESS [ 644.145253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.417241] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f4be817f-0835-4d88-ac8f-1efba342f06b None None] Enqueued Resource ID: d2e9f042-d9d6-452b-be07-f0acd783c56d with Priority: HIGHEST for action port [ 644.417917] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e9f042-d9d6-452b-be07-f0acd783c56d with Priority: HIGHEST for action port [ 644.418313] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2e9f042-d9d6-452b-be07-f0acd783c56d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.418456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2e9f042-d9d6-452b-be07-f0acd783c56d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.418553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2e9f042-d9d6-452b-be07-f0acd783c56d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.419094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2e9f042-d9d6-452b-be07-f0acd783c56d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.419278] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2e9f042-d9d6-452b-be07-f0acd783c56d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [req-103789fa-bc21-45a0-8432-ddffb053327b req-7c0e8693-db04-4ad6-9f9e-72aecaa82292 service nova] Enqueued Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_rules [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [req-103789fa-bc21-45a0-8432-ddffb053327b req-7c0e8693-db04-4ad6-9f9e-72aecaa82292 service nova] Enqueued Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [req-103789fa-bc21-45a0-8432-ddffb053327b req-7c0e8693-db04-4ad6-9f9e-72aecaa82292 service nova] Enqueued Resource ID: 3604483d-5d0b-43c1-8b6f-c5443da0c789 with Priority: HIGHEST for action port [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_rules [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 644.809202] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3604483d-5d0b-43c1-8b6f-c5443da0c789 with Priority: HIGHEST for action port [ 644.809727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.809727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.809727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.809727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.809998] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.810724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.810845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.810910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.811130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.811986] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.811986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.811986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.811986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.811986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.811986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.812578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3604483d-5d0b-43c1-8b6f-c5443da0c789 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.812665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.812724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.812940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.813019] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3604483d-5d0b-43c1-8b6f-c5443da0c789',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.921784] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2e9f042-d9d6-452b-be07-f0acd783c56d [ 644.922033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.922220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.922301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.922522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.922613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.922708] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2e9f042-d9d6-452b-be07-f0acd783c56d already deleted. [ 644.922788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2e9f042-d9d6-452b-be07-f0acd783c56d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.316274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.316274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.316274] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.320678] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3604483d-5d0b-43c1-8b6f-c5443da0c789 with status ACTIVE [ 645.320865] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.321474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.321474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.321860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.321860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.321928] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.322131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.322131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.322239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.322321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.322697] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.322697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.322697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.322871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.322871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.322939] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3604483d-5d0b-43c1-8b6f-c5443da0c789 is going to be updated. [ 645.347089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.347722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.347722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.347722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.347722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.348042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3604483d-5d0b-43c1-8b6f-c5443da0c789" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.420323] env[65455]: INFO networking_nsxv3.common.synchronization [req-660ffcca-fd2e-4419-be81-869422064115 req-881da049-ca0a-416b-9458-d9191ef4aea2 tempest-ServersV294TestFqdnHostnames-2000943012 tempest-ServersV294TestFqdnHostnames-2000943012-project-member] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 645.420323] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 645.420802] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.420802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.420802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.420949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.421674] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.421793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.421860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.422055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.422598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.422598] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.566267] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c630c677-8c81-45ec-9a11-48db2eac5a85 None None] Enqueued Resource ID: 5919b648-76ba-4188-81e7-d6ff42fcdde0 with Priority: HIGHEST for action port [ 645.566267] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5919b648-76ba-4188-81e7-d6ff42fcdde0 with Priority: HIGHEST for action port [ 645.566788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5919b648-76ba-4188-81e7-d6ff42fcdde0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.567807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5919b648-76ba-4188-81e7-d6ff42fcdde0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.568035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5919b648-76ba-4188-81e7-d6ff42fcdde0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.568404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5919b648-76ba-4188-81e7-d6ff42fcdde0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.568617] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5919b648-76ba-4188-81e7-d6ff42fcdde0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.808251] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.808432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-36" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.808549] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-36" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.808916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-36" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.809179] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.809335] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.809443] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.809663] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.809803] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.810019] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.810217] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.810821] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.810821] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.810821] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.810821] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.810995] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.821736] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.832636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.832636] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.832820] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.832982] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-36" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.833462] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-dd0e2d59-4282-4a1c-89a5-faad695c819a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.833650] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.833766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.834114] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.834267] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0e2d59-4282-4a1c-89a5-faad695c819a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.925090] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.925253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.925321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.925544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.925631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.925827] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.925919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.925984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.926179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.926238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.926294] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 already deleted. [ 645.926448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.071457] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5919b648-76ba-4188-81e7-d6ff42fcdde0 [ 646.071751] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.071904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.072014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.072287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.072402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.072716] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5919b648-76ba-4188-81e7-d6ff42fcdde0 already deleted. [ 646.072716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5919b648-76ba-4188-81e7-d6ff42fcdde0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.323711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.323711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.323911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.324015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.324133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.324522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 is going to be created. [ 646.338387] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.338387] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.338609] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.338794] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.338932] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.339102] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port dd0e2d59-4282-4a1c-89a5-faad695c819a not found, creating... [ 646.339606] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.339606] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.339606] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.339843] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.339965] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.340254] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.340670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.340670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.340802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.340949] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.341601] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: dd0e2d59-4282-4a1c-89a5-faad695c819a is going to be created. [ 646.354495] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.355278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.355278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.355365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.355529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.367771] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.367771] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.367771] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.368132] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.369235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.369235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.370617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: UNINITIALIZED for 2s [ 646.778679] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d822df1b-43be-4670-b2c1-8fd44182f4cf None None] Enqueued Resource ID: 5d1832f3-e315-4db6-9ed4-14ebef144404 with Priority: HIGHEST for action port [ 646.778679] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d1832f3-e315-4db6-9ed4-14ebef144404 with Priority: HIGHEST for action port [ 646.779556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d1832f3-e315-4db6-9ed4-14ebef144404 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.779556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d1832f3-e315-4db6-9ed4-14ebef144404" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.779556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d1832f3-e315-4db6-9ed4-14ebef144404" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.779910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d1832f3-e315-4db6-9ed4-14ebef144404" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.780143] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d1832f3-e315-4db6-9ed4-14ebef144404',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.102684] env[65455]: INFO networking_nsxv3.common.synchronization [req-660ffcca-fd2e-4419-be81-869422064115 req-10888908-cabd-426c-ae1a-aa4e002e9af2 service nova] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 647.102795] env[65455]: INFO networking_nsxv3.common.synchronization [req-660ffcca-fd2e-4419-be81-869422064115 req-10888908-cabd-426c-ae1a-aa4e002e9af2 service nova] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 647.104282] env[65455]: INFO networking_nsxv3.common.synchronization [req-660ffcca-fd2e-4419-be81-869422064115 req-10888908-cabd-426c-ae1a-aa4e002e9af2 service nova] Enqueued Resource ID: dd0e2d59-4282-4a1c-89a5-faad695c819a with Priority: HIGHEST for action port [ 647.104282] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_rules [ 647.104282] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 647.104282] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd0e2d59-4282-4a1c-89a5-faad695c819a with Priority: HIGHEST for action port [ 647.104282] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.104282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.104282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.104612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.104612] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.105762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.105887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.105887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.106027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.106186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.106758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.106758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.106758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.106758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.106758] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.107823] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd0e2d59-4282-4a1c-89a5-faad695c819a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.107823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.107823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.107823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.108278] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd0e2d59-4282-4a1c-89a5-faad695c819a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.283759] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d1832f3-e315-4db6-9ed4-14ebef144404 [ 647.283759] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.283759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.283759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.284508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.284508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.284508] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d1832f3-e315-4db6-9ed4-14ebef144404 already deleted. [ 647.284508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d1832f3-e315-4db6-9ed4-14ebef144404" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.609586] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.610837] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.610988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.611298] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd0e2d59-4282-4a1c-89a5-faad695c819a with status ACTIVE [ 647.611298] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.611464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.611558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.611921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.611921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.612173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.612173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.612173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.612394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.612394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.612494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.612570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.612619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.613477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.613622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.613686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd0e2d59-4282-4a1c-89a5-faad695c819a is going to be updated. [ 647.637817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.637954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.638049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.638251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.638387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.638544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd0e2d59-4282-4a1c-89a5-faad695c819a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.731091] env[65455]: INFO networking_nsxv3.common.synchronization [req-0ea2e567-8c72-418d-8448-89ac7ecc3674 req-8a7fe834-f124-481a-b4aa-b78ccdbc547b tempest-ServerTagsTestJSON-139058559 tempest-ServerTagsTestJSON-139058559-project-member] Enqueued Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 647.731546] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 647.731813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.731938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.732035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.734508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.734710] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.734832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.734893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.736255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.736255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.736255] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.116179] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.169259] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-655 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.169513] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-655" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.169644] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-655" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.170167] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-655" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.170523] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.170833] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.171542] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.171542] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.171745] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.172136] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.172136] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.172283] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.172413] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.172574] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.172688] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.172813] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.196270] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.196546] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.196741] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.196997] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-655" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.197402] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.198112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.198112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.198112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.199083] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44887a3d-082a-4b47-af8c-bc2ef5ee8dc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.239470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.240263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.240263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.240411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.240460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.240927] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.240927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.240927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.241117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.241117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.241214] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 already deleted. [ 648.241294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.381577] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: SUCCESS [ 648.381577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.381821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.381968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.382168] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.382761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.382761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.382761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.382761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.382761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.382761] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.620341] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.620519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.620993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.620993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.620993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.620993] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 is going to be created. [ 648.649142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.649289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.649360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.649619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.649798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.661088] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: UNINITIALIZED for 2s [ 648.702541] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.706018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 not found, creating... [ 648.706018] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.706018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.706457] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.706457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.706457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.706457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.706457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.706687] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 is going to be created. [ 648.727428] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.727883] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.728156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.728534] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.728892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.729474] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.806854] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ecf77cfb-1708-490e-aa6b-3133cf9452d3 None None] Enqueued Resource ID: bc1f86de-2b3f-4413-9d4b-0fb7759221b4 with Priority: HIGHEST for action port [ 648.806854] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1f86de-2b3f-4413-9d4b-0fb7759221b4 with Priority: HIGHEST for action port [ 648.806854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc1f86de-2b3f-4413-9d4b-0fb7759221b4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.806854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc1f86de-2b3f-4413-9d4b-0fb7759221b4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.806854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc1f86de-2b3f-4413-9d4b-0fb7759221b4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.806854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc1f86de-2b3f-4413-9d4b-0fb7759221b4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.806854] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc1f86de-2b3f-4413-9d4b-0fb7759221b4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.886401] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.886612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.886660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.887418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.887670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.887849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.887849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.887977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.888164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.889628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.889810] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.889939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.890025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.890145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.890293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.890394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.890461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.890591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.890662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.890752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.890897] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.309357] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc1f86de-2b3f-4413-9d4b-0fb7759221b4 [ 649.309677] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.310072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.310202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.310436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.310535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.310637] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc1f86de-2b3f-4413-9d4b-0fb7759221b4 already deleted. [ 649.310723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc1f86de-2b3f-4413-9d4b-0fb7759221b4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.393363] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a002e78-68ea-47cf-a3fa-5807e1bee919: rpc.has_security_group_logging(os_id): False [ 649.413430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.413864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.413955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.414228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.414489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.414837] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.414992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.414992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.415198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.415287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.415512] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.415614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.415680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.415836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.415915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.416568] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.416730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.416830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.417118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.417250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.417417] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 is going to be created. [ 649.485164] env[65455]: INFO networking_nsxv3.common.synchronization [req-0ea2e567-8c72-418d-8448-89ac7ecc3674 req-20866e17-9120-48d7-b6a7-67321fd8ecb8 service nova] Enqueued Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_rules [ 649.485164] env[65455]: INFO networking_nsxv3.common.synchronization [req-0ea2e567-8c72-418d-8448-89ac7ecc3674 req-20866e17-9120-48d7-b6a7-67321fd8ecb8 service nova] Enqueued Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 649.485352] env[65455]: INFO networking_nsxv3.common.synchronization [req-0ea2e567-8c72-418d-8448-89ac7ecc3674 req-20866e17-9120-48d7-b6a7-67321fd8ecb8 service nova] Enqueued Resource ID: 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 with Priority: HIGHEST for action port [ 649.488510] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.488510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.488510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.488510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.488510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.489506] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_rules [ 649.489506] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 649.489506] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 with Priority: HIGHEST for action port [ 649.489506] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.489688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.489688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.489922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.490015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.491057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.491207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.491357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.491421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.491537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.491637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.491703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.492147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.492147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.492147] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.493901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.493901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.493901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.493901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.493901] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44887a3d-082a-4b47-af8c-bc2ef5ee8dc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.511854] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: IN_PROGRESS for 2s [ 649.835616] env[65455]: INFO networking_nsxv3.common.synchronization [req-8d8eeebc-e446-4828-a139-d518d1f8b211 req-99d73ca9-224c-45f7-af09-3d38a8296971 tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 649.836197] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 649.836564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.836692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.836762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.837659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.837866] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.838025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.838123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.838327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.838451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.838574] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.996121] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.999069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.999338] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.000395] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 with status ACTIVE [ 650.000656] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.000892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.000892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.001053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.001113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.001292] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.001395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.001477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.001619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.001967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.001967] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.001967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.003276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.003520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.003612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.003711] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44887a3d-082a-4b47-af8c-bc2ef5ee8dc9 is going to be updated. [ 650.038676] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.038953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.039048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.039359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.039507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.039737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44887a3d-082a-4b47-af8c-bc2ef5ee8dc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.280058] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.280351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.280351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.280676] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.280926] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.281520] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.282339] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.282612] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.282795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.283119] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.283326] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.283539] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.283597] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.283667] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.283768] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.283897] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.307988] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.308916] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.309867] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.309867] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.309867] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.309867] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.310421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.310421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.310421] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8993ad1-544d-4e1f-90df-c4c33c58a6fb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.341753] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.341753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.341753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.341972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.342037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.342220] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.342347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.342394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.342551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.342632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.342718] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 already deleted. [ 650.342798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.505643] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.591693] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5d760706-f8d3-4a4a-a036-4caa3b37c209 None None] Enqueued Resource ID: 06abea36-3455-4c56-b7ad-e034e0e51292 with Priority: HIGHEST for action port [ 650.591693] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06abea36-3455-4c56-b7ad-e034e0e51292 with Priority: HIGHEST for action port [ 650.591693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-06abea36-3455-4c56-b7ad-e034e0e51292 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.591861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06abea36-3455-4c56-b7ad-e034e0e51292" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.591861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06abea36-3455-4c56-b7ad-e034e0e51292" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.592436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06abea36-3455-4c56-b7ad-e034e0e51292" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.593326] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06abea36-3455-4c56-b7ad-e034e0e51292',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.672262] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: SUCCESS [ 650.672262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.672262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.672262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.672262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.672772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.673057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.673527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.675087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.675364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.675489] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.813859] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.814755] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.814896] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.815199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.815360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.815550] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port b8993ad1-544d-4e1f-90df-c4c33c58a6fb not found, creating... [ 650.815845] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.816016] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.816131] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.816419] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.816565] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.817594] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.817831] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.817988] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.818267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.818450] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.818637] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: b8993ad1-544d-4e1f-90df-c4c33c58a6fb is going to be created. [ 650.840668] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.841122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.841301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.841629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.841944] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.842192] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.009328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.009328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.009328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.009328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.009328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.009328] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 is going to be created. [ 651.038491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.039069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.039069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.039069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.039257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.051029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: UNINITIALIZED for 2s [ 651.096257] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06abea36-3455-4c56-b7ad-e034e0e51292 [ 651.096541] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.096696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.096788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.097080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.097171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.097338] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06abea36-3455-4c56-b7ad-e034e0e51292 already deleted. [ 651.097430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06abea36-3455-4c56-b7ad-e034e0e51292" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.181752] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.530864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: SUCCESS [ 651.531364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.659749] env[65455]: INFO networking_nsxv3.common.synchronization [req-8d8eeebc-e446-4828-a139-d518d1f8b211 req-6c3c86d6-7cab-41b6-b55a-7c3647fba7dc service nova] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 651.660008] env[65455]: INFO networking_nsxv3.common.synchronization [req-8d8eeebc-e446-4828-a139-d518d1f8b211 req-6c3c86d6-7cab-41b6-b55a-7c3647fba7dc service nova] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 651.660227] env[65455]: INFO networking_nsxv3.common.synchronization [req-8d8eeebc-e446-4828-a139-d518d1f8b211 req-6c3c86d6-7cab-41b6-b55a-7c3647fba7dc service nova] Enqueued Resource ID: b8993ad1-544d-4e1f-90df-c4c33c58a6fb with Priority: HIGHEST for action port [ 651.660927] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 651.662022] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 651.662153] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8993ad1-544d-4e1f-90df-c4c33c58a6fb with Priority: HIGHEST for action port [ 651.662475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.662731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.662846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.663284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.663436] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.665049] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.665125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.665195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.665460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.665692] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.665832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.665898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.666076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.666224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.666272] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.667183] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.667310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.667365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.667515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.667594] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8993ad1-544d-4e1f-90df-c4c33c58a6fb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.684263] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38ce0832-87af-446e-9ffb-4cf08e497970: rpc.has_security_group_logging(os_id): False [ 651.704766] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.705269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.705330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.705527] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.705841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.705903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.706014] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 is going to be created. [ 651.751841] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 651.752156] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 651.752762] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 651.752903] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 651.754158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.754461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.756135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.756135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.758426] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.758426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.758545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.758700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.758857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.759034] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.761922] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-52b9e5b7-da17-4c27-ac49-48630b2813d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.762129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.762255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.762597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.762806] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.763082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.763217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.763595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.763595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.763717] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.767241] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.767388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.767510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.767643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.767833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.780150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: IN_PROGRESS for 2s [ 651.803797] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_rules [ 651.803970] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 651.804110] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 651.804342] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 651.804471] env[65455]: INFO networking_nsxv3.common.synchronization [req-7527074e-ac3b-4b29-9c47-1936e5b7585f req-dc8410f6-a5c4-433e-b97e-0dce01807f57 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 651.805028] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_rules [ 651.805572] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 651.805697] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 651.805797] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 651.805876] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 651.806175] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52b9e5b7-da17-4c27-ac49-48630b2813d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.806418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.806418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.806698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.806771] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.807728] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.807879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.807948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.808130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.808203] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.812200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f19a3a49-a886-4a96-9138-06d79373ec05 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.812200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.812200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.812200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.812200] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19a3a49-a886-4a96-9138-06d79373ec05',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.812200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-52b9e5b7-da17-4c27-ac49-48630b2813d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.812200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.812200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.812200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.097756] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf47a204-6ac0-45dd-bc24-2a78d2f06cd7 req-f4f996a1-4221-4364-b4c5-5deeb1cc5bfc tempest-SecurityGroupRulesNegativeTestJSON-216918017 tempest-SecurityGroupRulesNegativeTestJSON-216918017-project-member] Enqueued Resource ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b with Priority: HIGHEST for action security_group_rules [ 652.098376] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b with Priority: HIGHEST for action security_group_rules [ 652.099032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.099032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.099201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.099330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.099433] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f9d874-74d1-4071-98cd-6ca59e0e683b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.169265] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.170587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.170722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.174664] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8993ad1-544d-4e1f-90df-c4c33c58a6fb with status ACTIVE [ 652.174882] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.175051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.175131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.175370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.175465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.175659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.175772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.175838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.176015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.176116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.176376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.176522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.176596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.176766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.176852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.176946] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8993ad1-544d-4e1f-90df-c4c33c58a6fb is going to be updated. [ 652.202272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.202687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.202827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.202990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.203143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.203308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8993ad1-544d-4e1f-90df-c4c33c58a6fb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.220076] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac58b6fc-4a7a-4a6a-9b1b-a33a1bd76e80 req-f43bbf38-4e91-49cb-9458-cffb798cdcda tempest-VolumesAdminNegativeTest-2091318921 tempest-VolumesAdminNegativeTest-2091318921-project-member] Enqueued Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 652.220810] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 652.221952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.222166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.222268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.222592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.222791] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.222955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.223275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.223515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.223898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.224128] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.265520] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.266588] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.311412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.311608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.313556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-52b9e5b7-da17-4c27-ac49-48630b2813d8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.313687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.315122] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f19a3a49-a886-4a96-9138-06d79373ec05 with status ACTIVE [ 652.315303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.315446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.315514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.315738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.315824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.315991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.316099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.316160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.316388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.316478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.316685] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.316790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.316855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.317214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.317214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.317489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f19a3a49-a886-4a96-9138-06d79373ec05 is going to be updated. [ 652.350054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.350054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.350418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.350774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.350774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.350901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.631845] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.632305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-690" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.633034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-690" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.633034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-690" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.633183] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.633296] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.633423] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.633687] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.633970] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.633970] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.634104] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.634267] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.634376] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.634482] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.634577] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.634703] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.638772] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.638944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.639078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.639220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.639391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.639440] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b already deleted. [ 652.639491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.668472] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.668472] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.668472] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.668623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-690" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.668969] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-4669575c-9da7-42e7-b194-fd3be62db7ca taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.669198] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.669356] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.669735] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.669914] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4669575c-9da7-42e7-b194-fd3be62db7ca',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.677295] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.729333] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.729333] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.729333] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 already deleted. [ 652.729333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.768053] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.769105] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.063732] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: SUCCESS [ 653.063957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.064153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.064601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.064742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.064909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.064909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.065145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.065190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.065297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.065379] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.179397] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.180512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.180512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.180512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.180512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.180512] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 4669575c-9da7-42e7-b194-fd3be62db7ca not found, creating... [ 653.180850] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.180850] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.180960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.181231] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.181355] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.182627] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.182627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.182627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.182627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.182627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.182627] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 4669575c-9da7-42e7-b194-fd3be62db7ca is going to be created. [ 653.183745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.183745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.183973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.183973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.184071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.184123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be created. [ 653.215043] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.215043] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.215043] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.215272] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.215308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.215635] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.219600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.219797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.219857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.220042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.220201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.231171] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: UNINITIALIZED for 2s [ 653.273470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.275776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.275776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.275776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.275776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.275776] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 is going to be created. [ 653.276486] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.276675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.276798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.277122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.277276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.277438] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 653.334415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.334563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.334635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.334862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.335031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.343081] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.343081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.343081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.343081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.343081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.361859] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 653.363171] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 in Status: UNINITIALIZED for 2s [ 653.570994] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.571251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.571251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.571527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.571743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.571872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.571933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.572118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.572220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.572354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.572494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.572574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.572611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.572760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.572901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.573052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.573052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.573199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.573272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.573359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.573448] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.614317] env[65455]: INFO networking_nsxv3.common.synchronization [req-034c7183-079d-4e66-a7c2-0cf6db5c58fb req-bdf251e0-b69b-4be6-ac12-3f172021cc59 tempest-ImagesNegativeTestJSON-1239426278 tempest-ImagesNegativeTestJSON-1239426278-project-member] Enqueued Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 653.614989] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGHEST for action security_group_members [ 653.615494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.615711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.615874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.616205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.616563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.616785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.616988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.617331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.617502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.617666] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.797236] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: SUCCESS [ 653.797236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.977642] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac58b6fc-4a7a-4a6a-9b1b-a33a1bd76e80 req-45d00fc6-144c-4676-a4ad-8c6f9fca8599 service nova] Enqueued Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_rules [ 653.977824] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac58b6fc-4a7a-4a6a-9b1b-a33a1bd76e80 req-45d00fc6-144c-4676-a4ad-8c6f9fca8599 service nova] Enqueued Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 653.977952] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac58b6fc-4a7a-4a6a-9b1b-a33a1bd76e80 req-45d00fc6-144c-4676-a4ad-8c6f9fca8599 service nova] Enqueued Resource ID: 4669575c-9da7-42e7-b194-fd3be62db7ca with Priority: HIGHEST for action port [ 653.978619] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_rules [ 653.978793] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 653.978994] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4669575c-9da7-42e7-b194-fd3be62db7ca with Priority: HIGHEST for action port [ 653.979260] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.979372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.980881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.980881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.980881] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.981310] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.981582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.981582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.981777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.982443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.982443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.982443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.982443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.982443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.982655] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.983925] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4669575c-9da7-42e7-b194-fd3be62db7ca taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.984100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.984211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.984424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.984506] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4669575c-9da7-42e7-b194-fd3be62db7ca',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.077838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 638a5dec-549c-4c78-9abf-ae2d5f9d5265: rpc.has_security_group_logging(os_id): False [ 654.101027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.101027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.101027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.102442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.102914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.105673] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.105673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.105673] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 is going to be created. [ 654.121970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.121970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.121970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.121970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.121970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.121970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.124095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.124095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.124095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.124095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.124095] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 is going to be updated. [ 654.159586] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.159586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.159586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.159586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.159586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.176953] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: IN_PROGRESS for 2s [ 654.194296] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.194296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.194296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.194296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.194296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.209930] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: IN_PROGRESS for 2s [ 654.486647] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.486855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.487030] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.488148] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4669575c-9da7-42e7-b194-fd3be62db7ca with status ACTIVE [ 654.488377] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.488519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.488638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.488879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.488974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.489170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.489272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.489339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.489506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.489590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.489822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.489930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.494291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.494563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.494670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.494773] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4669575c-9da7-42e7-b194-fd3be62db7ca is going to be updated. [ 654.520332] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.520492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.520563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.520910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.521113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.521348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4669575c-9da7-42e7-b194-fd3be62db7ca" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.998235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.062355] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0bd8947-6510-4cd3-9017-dcabd1e36c94 req-c954b773-41a6-4ba9-ac9c-bdfa56c9fc32 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 655.062595] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0bd8947-6510-4cd3-9017-dcabd1e36c94 req-c954b773-41a6-4ba9-ac9c-bdfa56c9fc32 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 655.063494] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 655.063494] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 with Priority: HIGHEST for action security_group_members [ 655.064476] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.064597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.064933] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-52b9e5b7-da17-4c27-ac49-48630b2813d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.065053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.068903] env[65455]: INFO networking_nsxv3.common.synchronization [req-d69cd1d1-7464-4899-8c19-670e32e65fa8 req-5b5d6b35-4182-427d-b949-90859cf89fdd tempest-ServerDiagnosticsNegativeTest-230203940 tempest-ServerDiagnosticsNegativeTest-230203940-project-member] Enqueued Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 655.069841] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 655.070869] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.070992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.071070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.071381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.072208] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.072208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.072208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.072208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.072208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.072208] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.160654] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0bd8947-6510-4cd3-9017-dcabd1e36c94 req-c954b773-41a6-4ba9-ac9c-bdfa56c9fc32 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 655.160819] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0bd8947-6510-4cd3-9017-dcabd1e36c94 req-c954b773-41a6-4ba9-ac9c-bdfa56c9fc32 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 655.160901] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0bd8947-6510-4cd3-9017-dcabd1e36c94 req-c954b773-41a6-4ba9-ac9c-bdfa56c9fc32 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 655.161536] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_rules [ 655.161754] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 655.161897] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f19a3a49-a886-4a96-9138-06d79373ec05 with Priority: HIGHEST for action port [ 655.162277] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.162592] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.162855] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f19a3a49-a886-4a96-9138-06d79373ec05 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.163042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.163231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.163315] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f19a3a49-a886-4a96-9138-06d79373ec05',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.243108] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 655.243340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.243527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.243799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.244011] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.244360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.244360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.244483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.244599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.244715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.244826] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.373335] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 in Status: SUCCESS [ 655.373573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.373750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.373970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.374194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.374352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.374400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.374553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.374644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.375097] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.376560] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378198] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.378198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.378198] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.504405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.504566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.504658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.504882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.505127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.505127] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 is going to be created. [ 655.534158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.534327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.534327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.534551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.534718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.540695] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.540999] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.541208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.541617] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.542329] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.542329] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.542329] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.542743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.542743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.542743] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.542853] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.542994] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.543132] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.543244] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.543357] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.543487] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.546813] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: UNINITIALIZED for 2s [ 655.571561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.571760] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.571862] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.572054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.572402] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-ec17471c-26b3-4c1d-844a-bab6210ea0a5 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.572567] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.572674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.573052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.573196] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec17471c-26b3-4c1d-844a-bab6210ea0a5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.575207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.575524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.575524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.575690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.575690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.575875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.575968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.576077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.576202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.576340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.576439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ddf7c7-f7d9-457a-834f-979355b01964 already deleted. [ 655.576527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.665720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f19a3a49-a886-4a96-9138-06d79373ec05 with status ACTIVE [ 655.665786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.665950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.665950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.666208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.666368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.666582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.666677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.666739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.666917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.666999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.667196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.667308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.667374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.667526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.667636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.667690] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f19a3a49-a886-4a96-9138-06d79373ec05 is going to be updated. [ 655.696588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.696833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.697502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.697502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.697653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.699546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f19a3a49-a886-4a96-9138-06d79373ec05" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.748329] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.880233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.881849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.881849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.882311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.882311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.882311] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 is going to be deleted. [ 655.885346] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.931344] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.931344] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.931344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.932016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.932016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.932016] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.078054] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.078422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.078535] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.079071] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.079817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.079817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port ec17471c-26b3-4c1d-844a-bab6210ea0a5 not found, creating... [ 656.080216] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.080468] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.080640] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.080963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.081242] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.081648] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.081915] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.082222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.082340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.082506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.083016] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: ec17471c-26b3-4c1d-844a-bab6210ea0a5 is going to be created. [ 656.113523] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.113523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.113523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.113523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.113523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.113523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.190885] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 in Status: SUCCESS [ 656.190885] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 deletion is rescheduled due to dependency. [ 656.191912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.226687] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: SUCCESS [ 656.227069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.249784] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42a8d0a2-99ce-4c84-bb03-a9bf686e0924: rpc.has_security_group_logging(os_id): False [ 656.277763] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.278024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.278024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.278290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.278415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.278955] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.279275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.279275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.279439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.279540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.279585] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be created. [ 656.369789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.369989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.370374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.370424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.370642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.388765] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: IN_PROGRESS for 2s [ 656.389097] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.435126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.435399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.435399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.435569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.435659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.435867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.435965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.436039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.436348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.436485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.436538] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 already deleted. [ 656.436587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.436798] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.439430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.439684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.439939] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.440126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.440126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.440550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.440550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.440550] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.842798] env[65455]: INFO networking_nsxv3.common.synchronization [req-d69cd1d1-7464-4899-8c19-670e32e65fa8 req-5c6673fe-db27-465c-be8b-16aa8f4a5880 service nova] Enqueued Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_rules [ 656.843108] env[65455]: INFO networking_nsxv3.common.synchronization [req-d69cd1d1-7464-4899-8c19-670e32e65fa8 req-5c6673fe-db27-465c-be8b-16aa8f4a5880 service nova] Enqueued Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 656.843250] env[65455]: INFO networking_nsxv3.common.synchronization [req-d69cd1d1-7464-4899-8c19-670e32e65fa8 req-5c6673fe-db27-465c-be8b-16aa8f4a5880 service nova] Enqueued Resource ID: ec17471c-26b3-4c1d-844a-bab6210ea0a5 with Priority: HIGHEST for action port [ 656.844081] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_rules [ 656.844312] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 656.844465] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec17471c-26b3-4c1d-844a-bab6210ea0a5 with Priority: HIGHEST for action port [ 656.844756] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.844901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.844971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.845346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.845629] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.847825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.847825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.847825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.847825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.847825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.847825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.848572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.848572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.848572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.848572] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.849473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec17471c-26b3-4c1d-844a-bab6210ea0a5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.849591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.849640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.849994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.849994] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec17471c-26b3-4c1d-844a-bab6210ea0a5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.891646] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.891885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.891953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.892223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.892348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.892477] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 656.924630] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.924816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.924923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.925397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.925397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.937303] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 656.941982] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52b9e5b7-da17-4c27-ac49-48630b2813d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.943262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.943453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.943541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.943844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.943844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.944067] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.944186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.944186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.944378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.944457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.944542] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 already deleted. [ 656.944614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.354369] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.355885] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.355885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.356329] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec17471c-26b3-4c1d-844a-bab6210ea0a5 with status ACTIVE [ 657.356615] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.356771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.356864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.357180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.357371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.357620] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.357745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.357825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.358054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.358186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.358723] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.358723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.358723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.358723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.358986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.358986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec17471c-26b3-4c1d-844a-bab6210ea0a5 is going to be updated. [ 657.382405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.382594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.382666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.382934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.383096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.383262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec17471c-26b3-4c1d-844a-bab6210ea0a5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.446374] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52b9e5b7-da17-4c27-ac49-48630b2813d8: rpc.has_security_group_logging(os_id): False [ 657.470727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.470727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.470972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.471062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.471271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.471447] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.471600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.471713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.471993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.473570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.473570] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 is going to be created. [ 657.534124] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8], does not exist path=[/infra/domains/default/groups/52b9e5b7-da17-4c27-ac49-48630b2813d8]."\n}' [ 657.534451] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8 [ 657.534570] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 657.564889] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: SUCCESS [ 657.565050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.565467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.565834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.565973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.566139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.566824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.567192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.567336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.567529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.567668] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.595393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.596380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.596380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.596380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.597147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.597385] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.597589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.597589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.597798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.597903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.598152] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.598729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.599129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.599391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.599491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.599634] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52b9e5b7-da17-4c27-ac49-48630b2813d8 is going to be created. [ 657.623740] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8], does not exist path=[/infra/domains/default/groups/52b9e5b7-da17-4c27-ac49-48630b2813d8]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8 [ 657.623740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52b9e5b7-da17-4c27-ac49-48630b2813d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.624460] env[65455]: Traceback (most recent call last): [ 657.624535] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 657.624535] env[65455]: return func(*args, **kwargs) [ 657.624535] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 657.624535] env[65455]: res.raise_for_status() [ 657.624535] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 657.624535] env[65455]: raise HTTPError(http_error_msg, response=self) [ 657.624535] env[65455]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8 [ 657.624535] env[65455]: During handling of the above exception, another exception occurred: [ 657.624535] env[65455]: Traceback (most recent call last): [ 657.624535] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 657.624535] env[65455]: listener.cb(fileno) [ 657.624886] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 657.624886] env[65455]: result = function(*args, **kwargs) [ 657.624886] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 657.624886] env[65455]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 657.624886] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 657.624886] env[65455]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 657.624886] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 657.624886] env[65455]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 657.624886] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 657.624886] env[65455]: res.raise_for_status() [ 657.624886] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 657.624886] env[65455]: raise HTTPError(http_error_msg, response=self) [ 657.624886] env[65455]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/52b9e5b7-da17-4c27-ac49-48630b2813d8 [ 657.624886] env[65455]: Removing descriptor: 19 [ 657.861069] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.070697] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.070935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.071076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.071299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.071485] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.071612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.071718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.071902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.072016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.072119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.072273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.072367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.072421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.072596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.072758] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.072914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.072970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.073149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.073224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.073319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.073410] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.313767] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-8d7333eb-5abc-47d4-9512-3a6893c56299 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 658.314772] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 658.315102] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.315231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.315298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.315604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.315762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.315866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.315926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.316104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.316189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.316340] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.364508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.364796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.364796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.364929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.365091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.365212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ddf7c7-f7d9-457a-834f-979355b01964 is going to be created. [ 658.393540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.393884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.393884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.394175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.394393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405201] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: UNINITIALIZED for 2s [ 658.407092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 658.407447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.578800] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1cb582a8-be40-4b11-ac01-813b4c480718: rpc.has_security_group_logging(os_id): False [ 658.598640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.598804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.598874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.599104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.599181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.599408] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.599509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.599599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.599826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.599911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.600118] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.600226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.600304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.600412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.600486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.600662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.600753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.600807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.600948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.601044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.601117] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 is going to be created. [ 658.684539] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.684816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.684816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.685131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.685304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.699032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: IN_PROGRESS for 2s [ 658.810757] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-31076d5a-aa2a-42f3-88b5-932f039dd751 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 658.811394] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 658.813360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.813476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.818829] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.819053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.819053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.819308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.819418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.819613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.819717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.819776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.819942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.820033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.820142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c already deleted. [ 658.820198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.821167] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.821167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.821530] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.954023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.954023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.954023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.954023] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.955461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.955777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.956209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.956209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.956335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.956503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.956929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.956929] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.324772] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.324988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.325131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.325392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.325493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.325714] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.325819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.325886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.326111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.326212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.326378] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c already deleted. [ 659.326482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.429184] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-c21621c8-b9f3-476d-822e-33a2179ba45a tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 659.430734] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 659.431106] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.431169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.431370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.431505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.431660] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.431765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.431827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.432405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.432528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.432638] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.456238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.456459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.459245] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.739825] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.740049] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.740171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.740506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.740767] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.740924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.741183] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.741451] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.741610] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.741818] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.741925] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.742038] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.742145] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.742247] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.742345] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.742468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.765334] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.765505] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.765631] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.765805] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.766415] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-9c168543-80b3-4dd3-93b1-58a1d572270f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.766707] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.767762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.767762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.767762] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c168543-80b3-4dd3-93b1-58a1d572270f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.850726] env[65455]: INFO networking_nsxv3.common.synchronization [req-f98fc0f2-ec59-4641-b20d-4b1a5393d2dc req-f035261f-ad83-43d4-9690-d8f14b9c6f0e tempest-SecurityGroupRulesNegativeTestJSON-216918017 tempest-SecurityGroupRulesNegativeTestJSON-216918017-project-member] Enqueued Resource ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b with Priority: HIGHEST for action security_group_rules [ 659.851521] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b with Priority: HIGHEST for action security_group_rules [ 659.851853] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.852590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.852590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.852590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.852590] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f9d874-74d1-4071-98cd-6ca59e0e683b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.935563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.936097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.936352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.936739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.936984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.937725] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.937725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.937725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.937934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.937934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.938024] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c already deleted. [ 659.938173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.961326] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.271470] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.271664] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.271728] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.272077] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.272176] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.272337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 9c168543-80b3-4dd3-93b1-58a1d572270f not found, creating... [ 660.272629] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.272749] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.272865] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.273123] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.273258] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.273684] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.273684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.273812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.274127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.274283] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.274436] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 9c168543-80b3-4dd3-93b1-58a1d572270f is going to be created. [ 660.298672] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.299041] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.299161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.299497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.299874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.300206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.372783] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.373032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.373165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.373588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.373736] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f9d874-74d1-4071-98cd-6ca59e0e683b already deleted. [ 660.373877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f9d874-74d1-4071-98cd-6ca59e0e683b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.416355] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: SUCCESS [ 660.416606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.416777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.417083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.417221] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.418389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.418389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.418389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.418389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.418389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.418389] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.466422] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.467894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.467894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 660.526371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.526371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.526371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.526371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.526371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.551438] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 660.717277] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: SUCCESS [ 660.717572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.921738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.922824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.924822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.924822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.924822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.925894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.925894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.925894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.925894] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.017646] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-c52e95ea-5f75-4440-83d7-a6d815a6da97 service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 661.017823] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-c52e95ea-5f75-4440-83d7-a6d815a6da97 service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 661.018481] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-c52e95ea-5f75-4440-83d7-a6d815a6da97 service nova] Enqueued Resource ID: 9c168543-80b3-4dd3-93b1-58a1d572270f with Priority: HIGHEST for action port [ 661.018622] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 661.018752] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 661.018913] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c168543-80b3-4dd3-93b1-58a1d572270f with Priority: HIGHEST for action port [ 661.019137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.019276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.019373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.019662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.019747] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.020870] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.020870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.020870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.021182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.021337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.021337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.021584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.021657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.021742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.021817] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.022619] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c168543-80b3-4dd3-93b1-58a1d572270f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.023624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.023735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.023895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.023986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c168543-80b3-4dd3-93b1-58a1d572270f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.427563] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0ddf7c7-f7d9-457a-834f-979355b01964: rpc.has_security_group_logging(os_id): False [ 661.451994] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.452269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.453172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.453482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.453604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.453911] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.453982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.454035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.454256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.454356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.454561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.454657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.454717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.454867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.454944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.457097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.457256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.457370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.457670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.457801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.458798] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0ddf7c7-f7d9-457a-834f-979355b01964 is going to be created. [ 661.525871] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.526270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.526461] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.527779] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c168543-80b3-4dd3-93b1-58a1d572270f with status ACTIVE [ 661.528073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.529137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.529137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.529137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.529137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.529137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.529428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.529428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.529581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.529684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.529956] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.530104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.530266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.530864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.530864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.530864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c168543-80b3-4dd3-93b1-58a1d572270f is going to be updated. [ 661.535505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.536487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.536793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.537025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.537326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.551137] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: IN_PROGRESS for 2s [ 661.562656] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.562912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.562912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.563200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.563394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.563614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c168543-80b3-4dd3-93b1-58a1d572270f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.943395] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-560 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.943649] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-560" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.943767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-560" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.944119] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-560" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.945390] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.945390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.945390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.945390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.945588] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.946577] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.946577] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.946577] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.946577] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.946577] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.946577] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.946577] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.967955] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.968321] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.969710] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.969710] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-560" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.969710] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-dc572156-a9c4-45ca-9e2e-d50801de39f2 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.969710] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.969710] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.970553] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.970553] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc572156-a9c4-45ca-9e2e-d50801de39f2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.033025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.473479] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.473960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.474250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.474552] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.474799] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.475048] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port dc572156-a9c4-45ca-9e2e-d50801de39f2 not found, creating... [ 662.475653] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.475653] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.475877] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.476381] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.476626] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.477060] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.477280] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.477480] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.477767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.477970] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.478162] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: dc572156-a9c4-45ca-9e2e-d50801de39f2 is going to be created. [ 662.526059] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.526556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.526724] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.527497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.527497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.527693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.535750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.535906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.535978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.536229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.536324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.536522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be created. [ 662.566508] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 662.566744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.566907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.567149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.567364] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.567609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.567609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.567728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.567791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.567882] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.571724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.572843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.572949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.573181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.573459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.586590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: UNINITIALIZED for 2s [ 662.802978] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8d02c87b-b3e3-4277-a249-bce6e37cf31e None None] Enqueued Resource ID: 0ab853ef-9bbd-427f-b5d2-fcdc07912cdd with Priority: HIGHEST for action port [ 662.803725] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab853ef-9bbd-427f-b5d2-fcdc07912cdd with Priority: HIGHEST for action port [ 662.804150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab853ef-9bbd-427f-b5d2-fcdc07912cdd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.804338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab853ef-9bbd-427f-b5d2-fcdc07912cdd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.804393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab853ef-9bbd-427f-b5d2-fcdc07912cdd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.804696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab853ef-9bbd-427f-b5d2-fcdc07912cdd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.804800] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab853ef-9bbd-427f-b5d2-fcdc07912cdd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.076477] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.279193] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-3d9bfee5-9488-48ee-b93e-547b77921abb service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 663.279193] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-3d9bfee5-9488-48ee-b93e-547b77921abb service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 663.279193] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-3d9bfee5-9488-48ee-b93e-547b77921abb service nova] Enqueued Resource ID: dc572156-a9c4-45ca-9e2e-d50801de39f2 with Priority: HIGHEST for action port [ 663.279193] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 663.279193] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 663.279750] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc572156-a9c4-45ca-9e2e-d50801de39f2 with Priority: HIGHEST for action port [ 663.280736] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.280736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.284249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.284351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.284889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc572156-a9c4-45ca-9e2e-d50801de39f2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.285011] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.285077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.285278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.285598] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc572156-a9c4-45ca-9e2e-d50801de39f2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.307754] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ab853ef-9bbd-427f-b5d2-fcdc07912cdd [ 663.307927] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.307927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.308600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.308765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.308874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.308978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ab853ef-9bbd-427f-b5d2-fcdc07912cdd already deleted. [ 663.309129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab853ef-9bbd-427f-b5d2-fcdc07912cdd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.564756] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: SUCCESS [ 663.565114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.578092] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.657176] env[65455]: INFO networking_nsxv3.common.synchronization [req-1d812f0e-a15f-4f2a-993b-b8af66f0ce9a req-b7ab2ec0-08ff-4ace-b331-8bd2ab1cc836 tempest-FloatingIPsAssociationTestJSON-414106725 tempest-FloatingIPsAssociationTestJSON-414106725-project-member] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 663.657176] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 663.657856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.658721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.658721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.658721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.658721] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.658721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.658970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.659241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.659241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.659405] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.791541] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc572156-a9c4-45ca-9e2e-d50801de39f2 with status ACTIVE [ 663.791830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.791974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.792060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.792280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.792378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.792766] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.792878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.792941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.793370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.793370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.793567] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.793567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.793567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.793705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.793737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.793822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc572156-a9c4-45ca-9e2e-d50801de39f2 is going to be updated. [ 663.816554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.816773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.816904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.817195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.817434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.817662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc572156-a9c4-45ca-9e2e-d50801de39f2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.974478] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.974478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.974661] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.974903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.975192] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.975355] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.975466] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.975681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.975817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.976039] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.976160] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.976339] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.976446] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.976568] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.976692] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.976818] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.003173] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.003339] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.003477] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.003652] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-530" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.004311] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-4788236c-024d-45ac-9319-fe77f1239f5f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.004311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.004311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.004844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.004998] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4788236c-024d-45ac-9319-fe77f1239f5f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.080575] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.080741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.080805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.081044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.081141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.081243] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 664.114631] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.114863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.114970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.115376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.115603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.127253] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 664.161673] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.507442] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.510888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 4788236c-024d-45ac-9319-fe77f1239f5f not found, creating... [ 664.510888] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.510888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.512048] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.512546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.515546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.515546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.515546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.515546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 4788236c-024d-45ac-9319-fe77f1239f5f is going to be created. [ 664.542027] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.542027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.542027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.542027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.542027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.542027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.601511] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.601511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.601511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.602589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.602589] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.602680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.603028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.603213] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.603213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.603213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.603394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.603433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.603591] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.666456] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.014080] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.014312] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.014435] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.014712] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.014967] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.015135] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.015250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.015460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.015594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.015795] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.015903] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.016011] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.016131] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.016324] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.016371] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.016487] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.047957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.047957] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.047957] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.047957] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-904" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.048343] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-d7069b8c-4741-4cbd-8591-30a19136d23d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.048619] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.048619] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.048962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.049126] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7069b8c-4741-4cbd-8591-30a19136d23d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.105961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.106132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.106366] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.144821] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a79e31cc-0ed8-4449-a662-0555b5aa85a5 None None] Enqueued Resource ID: 4067ca28-01b5-4469-88d8-48b1de222cda with Priority: HIGHEST for action port [ 665.145664] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4067ca28-01b5-4469-88d8-48b1de222cda with Priority: HIGHEST for action port [ 665.145664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4067ca28-01b5-4469-88d8-48b1de222cda taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.145902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4067ca28-01b5-4469-88d8-48b1de222cda" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.145902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4067ca28-01b5-4469-88d8-48b1de222cda" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.146266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4067ca28-01b5-4469-88d8-48b1de222cda" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.146715] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4067ca28-01b5-4469-88d8-48b1de222cda',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.167044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.167392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.167392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.167557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.167655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.167775] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be updated. [ 665.210117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.210117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.210117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.210117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.210117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.221077] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 665.328097] env[65455]: INFO networking_nsxv3.common.synchronization [req-1d812f0e-a15f-4f2a-993b-b8af66f0ce9a req-de0714af-64e2-4300-a34f-772b607d0566 service nova] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_rules [ 665.328390] env[65455]: INFO networking_nsxv3.common.synchronization [req-1d812f0e-a15f-4f2a-993b-b8af66f0ce9a req-de0714af-64e2-4300-a34f-772b607d0566 service nova] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 665.328610] env[65455]: INFO networking_nsxv3.common.synchronization [req-1d812f0e-a15f-4f2a-993b-b8af66f0ce9a req-de0714af-64e2-4300-a34f-772b607d0566 service nova] Enqueued Resource ID: 4788236c-024d-45ac-9319-fe77f1239f5f with Priority: HIGHEST for action port [ 665.331432] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_rules [ 665.331432] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 665.331432] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4788236c-024d-45ac-9319-fe77f1239f5f with Priority: HIGHEST for action port [ 665.331432] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.331432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.331432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.331432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.332247] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.332346] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.332446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.332654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4788236c-024d-45ac-9319-fe77f1239f5f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.332744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.332799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.332947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.333026] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4788236c-024d-45ac-9319-fe77f1239f5f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.551980] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.552290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.552401] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.552688] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.552834] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.552982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port d7069b8c-4741-4cbd-8591-30a19136d23d not found, creating... [ 665.553266] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.553420] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.553532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.553755] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.553885] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.554182] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.554352] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.554458] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.554664] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.554788] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.554921] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: d7069b8c-4741-4cbd-8591-30a19136d23d is going to be created. [ 665.576777] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.576777] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.577000] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.577127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.577392] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.577681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.609937] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.649496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4067ca28-01b5-4469-88d8-48b1de222cda [ 665.649755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.649898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.649968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.650282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.650459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.650601] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4067ca28-01b5-4469-88d8-48b1de222cda already deleted. [ 665.650709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4067ca28-01b5-4469-88d8-48b1de222cda" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.836791] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.836924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.837130] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4788236c-024d-45ac-9319-fe77f1239f5f with status ACTIVE [ 665.837333] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.837437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.837504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.837721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.837810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.837982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.838160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.838322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.838403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.838581] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.838734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.838878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.838963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.839058] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4788236c-024d-45ac-9319-fe77f1239f5f is going to be updated. [ 665.863619] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.863816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.863816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.864050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.864246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.864405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4788236c-024d-45ac-9319-fe77f1239f5f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.112679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.112934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.112934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.116513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.116513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.116513] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 666.136561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 666.136822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.136884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.137110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.137336] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.137462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.137530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.137715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.137826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.137876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.138437] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.138437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.138437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.138437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.138634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.138634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.138634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.138779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.138818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.138874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.138965] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.146684] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.146825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.146890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.147189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.147285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.159021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 666.318038] env[65455]: INFO networking_nsxv3.common.synchronization [req-e1d3220a-3191-495f-8b0e-87553847856b req-2fd5553b-f219-42ed-b16c-03b684b20230 tempest-DeleteServersAdminTestJSON-968335089 tempest-DeleteServersAdminTestJSON-968335089-project-member] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 666.318535] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 666.318874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.319409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.319573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.319853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.320068] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.320242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.320349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.320678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.320678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.320836] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.340249] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-29928376-ff9c-4cc9-8778-ddf5ff458d1f service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 666.348025] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-29928376-ff9c-4cc9-8778-ddf5ff458d1f service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 666.348025] env[65455]: INFO networking_nsxv3.common.synchronization [req-8ef3bebc-4a5a-444c-a934-6624e90e00c4 req-29928376-ff9c-4cc9-8778-ddf5ff458d1f service nova] Enqueued Resource ID: d7069b8c-4741-4cbd-8591-30a19136d23d with Priority: HIGHEST for action port [ 666.348025] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 666.348025] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 666.348025] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7069b8c-4741-4cbd-8591-30a19136d23d with Priority: HIGHEST for action port [ 666.348025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.348025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.348025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.348025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.348025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7069b8c-4741-4cbd-8591-30a19136d23d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.348025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.348025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.348025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.348025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7069b8c-4741-4cbd-8591-30a19136d23d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.643517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b30223-71ca-4cf7-ab29-768aa4761f18: rpc.has_security_group_logging(os_id): False [ 666.672967] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.672967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.672967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.672967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.690604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.690604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.690604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.691099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.691450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.692999] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.692999] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.692999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.692999] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 666.768037] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.768296] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.768497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.768882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.769611] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.770253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.770374] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.770719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.770890] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.771412] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.771593] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.771918] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.772144] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.772203] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.772684] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.772755] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.777433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.777722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.777722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.777874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.777965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.791904] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 666.799962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.800141] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.800278] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.800455] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.800778] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-f6365df5-7cae-4c50-9ebc-001c9c9200cc taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.800950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.801075] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.801463] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.801603] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6365df5-7cae-4c50-9ebc-001c9c9200cc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.822724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.822888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.822967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.823217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.851649] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7069b8c-4741-4cbd-8591-30a19136d23d with status ACTIVE [ 666.852044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.852044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.852287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.852430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.852430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.852618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.852744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.852744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.852922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.853081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.853168] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.853293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.853524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.853524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.853524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.853835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7069b8c-4741-4cbd-8591-30a19136d23d is going to be updated. [ 666.856626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.856879] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.856998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.857089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.857312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.857455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.857553] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be updated. [ 666.897779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.897951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.898011] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.898286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.898453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.898629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7069b8c-4741-4cbd-8591-30a19136d23d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.902591] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.902761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.902810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.903012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.903163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.916814] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 667.232972] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 4s [ 667.305750] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.306078] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.306353] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.306772] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.306984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.307237] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port f6365df5-7cae-4c50-9ebc-001c9c9200cc not found, creating... [ 667.307664] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.307901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.308727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.309089] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.309626] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.309708] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.309923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.310090] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.310408] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.310595] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.310773] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: f6365df5-7cae-4c50-9ebc-001c9c9200cc is going to be created. [ 667.337095] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.337508] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.337620] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.337949] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.338222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.338519] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.028530] env[65455]: INFO networking_nsxv3.common.synchronization [req-e1d3220a-3191-495f-8b0e-87553847856b req-0556f92e-cefd-442f-867d-f7db7998651f service nova] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_rules [ 668.030122] env[65455]: INFO networking_nsxv3.common.synchronization [req-e1d3220a-3191-495f-8b0e-87553847856b req-0556f92e-cefd-442f-867d-f7db7998651f service nova] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 668.030122] env[65455]: INFO networking_nsxv3.common.synchronization [req-e1d3220a-3191-495f-8b0e-87553847856b req-0556f92e-cefd-442f-867d-f7db7998651f service nova] Enqueued Resource ID: f6365df5-7cae-4c50-9ebc-001c9c9200cc with Priority: HIGHEST for action port [ 668.030122] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_rules [ 668.030122] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 668.030122] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6365df5-7cae-4c50-9ebc-001c9c9200cc with Priority: HIGHEST for action port [ 668.033785] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.033785] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.033785] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.033785] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6365df5-7cae-4c50-9ebc-001c9c9200cc taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.033785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.033785] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6365df5-7cae-4c50-9ebc-001c9c9200cc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.172513] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 668.172720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.173565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.173871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.174115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.174260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.174330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.174475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.176064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.176064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.176064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.176064] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.177938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.179852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.179852] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.179852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.180133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.180178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.180279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.180400] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.457919] env[65455]: INFO networking_nsxv3.common.synchronization [req-c0190f78-596e-40ff-ba9b-ca658b7314f2 req-2b3a0f24-cde0-4852-92ff-39345aedb261 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 668.458482] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 668.459800] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.459993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.463337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.463337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463337] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.636616] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.636794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.636892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6365df5-7cae-4c50-9ebc-001c9c9200cc with status ACTIVE [ 668.637062] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.637452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.637452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.637452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.637675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.637675] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.637801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.637853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.639084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.639084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.639084] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6365df5-7cae-4c50-9ebc-001c9c9200cc is going to be updated. [ 668.664554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.664554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.664554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.664791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.664977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.665322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6365df5-7cae-4c50-9ebc-001c9c9200cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.682299] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2645787-f0c6-445b-afb0-d7c9acc45e6c: rpc.has_security_group_logging(os_id): False [ 668.688520] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.704431] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.704589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.706400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.706400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.706400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.706400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.706938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.706938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.706938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.706938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.706938] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be created. [ 668.809098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 668.809524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.809731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.810027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.810135] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.830030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.830189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.830436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.830688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.830870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.844404] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 668.866061] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.866460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.866460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.866712] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.867442] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.867616] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.867735] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.867954] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.868147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.868319] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.868424] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.868534] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.868621] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.868718] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.868850] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.868993] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.902291] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.902291] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.902291] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.902291] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.902629] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-74b51ce6-ac66-4e20-941d-55df68f8651a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.902786] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.902908] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.903403] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.903608] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b51ce6-ac66-4e20-941d-55df68f8651a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.935738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 668.936074] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 deletion is rescheduled due to dependency. [ 668.936398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.936647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.936960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.937241] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.937403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.937494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.937725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.937838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.937971] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.964483] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.964635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.964635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.964837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.000381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.000658] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.000789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.000857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.001105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.001195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.001291] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 669.029119] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.029531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.029531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.029531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.029676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.039108] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 669.190914] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.244504] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 669.244753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.244922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.245194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.245394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.245516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.245582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.245741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.245817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.245912] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.315151] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.315343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.315406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.315664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.315837] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.315941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.316021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.316226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.316325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.316419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.316508] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.406558] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.406798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.406921] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.407301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.407466] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.407632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 74b51ce6-ac66-4e20-941d-55df68f8651a not found, creating... [ 669.407911] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.408099] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.408213] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.408515] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.408589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.408870] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.409034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.409147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.409354] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.409477] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.409606] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 74b51ce6-ac66-4e20-941d-55df68f8651a is going to be created. [ 669.434686] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.434888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.434948] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.435266] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.435585] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.435817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.441449] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.693342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.693559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.693611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.693811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.693920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.694012] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 669.727962] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.728207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.728207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.728427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.728600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.739955] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 669.748508] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.818854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.819086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.819302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.819484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.819706] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.819833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.819935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.820148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.820261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.820381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.820576] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.820696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.820780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.821598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.821598] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.821598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.821598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.821598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.821598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.821870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.821870] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.943284] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.190826] env[65455]: INFO networking_nsxv3.common.synchronization [req-c0190f78-596e-40ff-ba9b-ca658b7314f2 req-b563e2b9-f19c-4481-ac3d-4ff7e38097ed service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 670.190826] env[65455]: INFO networking_nsxv3.common.synchronization [req-c0190f78-596e-40ff-ba9b-ca658b7314f2 req-b563e2b9-f19c-4481-ac3d-4ff7e38097ed service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 670.190826] env[65455]: INFO networking_nsxv3.common.synchronization [req-c0190f78-596e-40ff-ba9b-ca658b7314f2 req-b563e2b9-f19c-4481-ac3d-4ff7e38097ed service nova] Enqueued Resource ID: 74b51ce6-ac66-4e20-941d-55df68f8651a with Priority: HIGHEST for action port [ 670.191721] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 670.194742] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 670.194742] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74b51ce6-ac66-4e20-941d-55df68f8651a with Priority: HIGHEST for action port [ 670.195177] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.195288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.195365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.195510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.195591] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.196790] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.196907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.197906] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-74b51ce6-ac66-4e20-941d-55df68f8651a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.197906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.197906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.201210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.201295] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74b51ce6-ac66-4e20-941d-55df68f8651a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.252332] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.326854] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9b30223-71ca-4cf7-ab29-768aa4761f18: rpc.has_security_group_logging(os_id): False [ 670.348517] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.348680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.348738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.348975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.349096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.349301] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.349412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.349470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.349633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.349709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.349924] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.350051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.350116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.350263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.350340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.350525] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.350619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.350675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.350821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.350896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.350982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 670.414204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.414404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.414500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.414695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.414840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.431767] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 670.445597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.445752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.445820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.446065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.446208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.446324] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be updated. [ 670.482905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.483203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.483203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.483632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.484047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.493690] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 670.563669] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c7b74c07-e864-4b7e-a397-27f2a335dd1d None None] Enqueued Resource ID: af62533b-6104-4060-8729-f3222f447ade with Priority: HIGHEST for action port [ 670.569216] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af62533b-6104-4060-8729-f3222f447ade with Priority: HIGHEST for action port [ 670.569216] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-af62533b-6104-4060-8729-f3222f447ade taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.569216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af62533b-6104-4060-8729-f3222f447ade" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.569216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af62533b-6104-4060-8729-f3222f447ade" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.569216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af62533b-6104-4060-8729-f3222f447ade" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.569216] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af62533b-6104-4060-8729-f3222f447ade',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.705254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.705254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.705254] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74b51ce6-ac66-4e20-941d-55df68f8651a with status ACTIVE [ 670.705254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.705254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.705588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.705588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.705664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.706023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.706023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.706023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.706177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.706177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.706578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.706578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.706578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.706859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.706859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.706966] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74b51ce6-ac66-4e20-941d-55df68f8651a is going to be updated. [ 670.732248] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.732490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.732490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.732680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.732815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.732975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74b51ce6-ac66-4e20-941d-55df68f8651a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.753227] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.753449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.753512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.753692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.753781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.753879] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be updated. [ 670.798507] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.798679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.798724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.798938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.799140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.809060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 670.860885] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 670.861124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.861306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.861528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.861615] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.051424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 671.051619] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 671.051743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.051956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.052257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.052450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.052607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.054245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.054245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.054245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.054245] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.068833] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af62533b-6104-4060-8729-f3222f447ade [ 671.069070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.069204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.069270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.069493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.069580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.070872] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af62533b-6104-4060-8729-f3222f447ade already deleted. [ 671.070872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af62533b-6104-4060-8729-f3222f447ade" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.364882] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.365344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.555772] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.751131] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.754256] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.754256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.754256] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.061419] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.258415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.262880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.262880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.262880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.262880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.263625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.263625] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.451930] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 672.452307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.507098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 672.508304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.508716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.508840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.508937] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.509059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.510569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.510569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.510569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.510569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.510569] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.564854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.565041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.565041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.565201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.565289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.565386] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 672.606501] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.606501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.606501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.606501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.606501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.617507] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 672.767863] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2645787-f0c6-445b-afb0-d7c9acc45e6c: rpc.has_security_group_logging(os_id): False [ 672.796165] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.796165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.796165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.796165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.796165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.796165] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.796468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.796468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.796468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.796582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.796742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.796886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.796929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.797098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.798213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.798586] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.798756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.798866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.799107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.799232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.799331] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 672.818843] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 672.819084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.819698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.819924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.820162] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.820293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.820358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.820554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.820661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.820822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.820856] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.851086] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a6e506ba-f36c-4b5a-84e4-19d03f44fa47 None None] Enqueued Resource ID: 2226381c-24e6-4781-9834-998042522499 with Priority: HIGHEST for action port [ 672.851631] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2226381c-24e6-4781-9834-998042522499 with Priority: HIGHEST for action port [ 672.851963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2226381c-24e6-4781-9834-998042522499 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.852117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2226381c-24e6-4781-9834-998042522499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.852202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2226381c-24e6-4781-9834-998042522499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.852518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2226381c-24e6-4781-9834-998042522499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.852588] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2226381c-24e6-4781-9834-998042522499',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.891454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.891454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.891603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.891846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.891990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.907482] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 673.012680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.013554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.013554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.013554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.013554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.013554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.013554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.013981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.013981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.013981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.013981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.014149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.014149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.014237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.014369] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.014450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.014501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.015110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.015110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.015110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.015110] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.323578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.323767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.323821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.324177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.324381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.324503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.324580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.324795] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.324888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.325039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.325148] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.325229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.325295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.325435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.325580] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.325671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.325732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.325875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.325973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.328020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.328020] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.357895] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2226381c-24e6-4781-9834-998042522499 [ 673.357895] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.357895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.357895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.357895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.357895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.357895] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2226381c-24e6-4781-9834-998042522499 already deleted. [ 673.358338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2226381c-24e6-4781-9834-998042522499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.517483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6c141c29-42c3-41f9-b7dc-ffdc17a6c975: rpc.has_security_group_logging(os_id): False [ 673.541715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.541715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.541715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.542210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.542956] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.542956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.542956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.542956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.543718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.544822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.544822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.544822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.544822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.544822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.544822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be updated. [ 673.616095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.616095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.616095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.618660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.618660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.630365] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 673.831037] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d1eda5c-438c-423f-9e82-2cec12b4ecd8: rpc.has_security_group_logging(os_id): False [ 673.854267] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.854267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.854267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.854267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.878936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.879250] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.879371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.879438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.879640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.879726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.879904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.880006] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.880074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.880231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.880320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.880527] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.880625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.880689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.880838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.880917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.881043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be updated. [ 673.956706] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.956855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.956927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.957197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.957351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.005350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 674.523008] env[65455]: INFO networking_nsxv3.common.synchronization [req-8c52a118-05a8-4690-9dea-564964788827 req-598f4e79-0723-441f-91a7-ebe489bf2849 tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 674.523607] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 674.523920] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.525567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.525675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.525980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.526258] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.526392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.526467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.526651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.526742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.526838] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.628223] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 674.628594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.628785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.629311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.629311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.629311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.629311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.629763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.629763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.629763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.629763] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.864534] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8899fb79-5884-4138-96c1-ba84b41ab9b6 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 674.867809] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 674.868150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.868283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.868351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.868647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.868750] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.921682] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 674.921957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.922113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.922342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.922433] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.030710] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.030710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.030710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.030710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.030965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.031455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.031455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.031455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.031455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.031815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.031815] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 already deleted. [ 675.031815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.136947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.137254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.137254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.137543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.137763] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.138075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.138075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.138303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.138388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.138578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.138678] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.138785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.138785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.138925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.139061] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.139152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.139253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.139345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.139433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.139524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.139617] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.401470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.401668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.402093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.402093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.402251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.402320] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c already deleted. [ 675.402467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.426979] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.427262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.427351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.427663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.427904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.428076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.428179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.428421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.428584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.428714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.428853] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.642384] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 675.659865] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 675.660247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.671827] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.672075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.672075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.672295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.672427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.676094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.676094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.676094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.676094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.677130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.677130] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 675.681815] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.681815] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.682074] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.682452] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.682806] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.682993] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.683127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.683457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.683665] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.683918] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.684087] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.684248] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.684384] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.684519] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.684667] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.684850] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.714795] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.714892] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.715520] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.715520] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.715520] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.715820] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.715820] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.716249] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.716403] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4884a7ae-ed1c-4db2-b880-21ca0f4b1865',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.766737] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.767126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.767126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.767338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.767638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.787179] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 675.931345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.931528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.931591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.931817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.932436] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.932556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.932673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.932784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.932871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.932963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.933137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.933233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.933361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.933430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.933564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.933651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.933709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.933845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.933921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.934015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.934309] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.967669] env[65455]: INFO networking_nsxv3.common.synchronization [None req-fce37bf4-c167-4acc-9341-a88731c34b81 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 675.967953] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 675.968282] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.968414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.968492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.969375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.969491] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.018457] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 676.018668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.219340] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.219933] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.219933] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.220294] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.220294] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.220435] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 not found, creating... [ 676.221274] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.221274] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.221274] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.221274] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.221461] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222165] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.222165] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.222165] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.222603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.222798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222947] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 is going to be created. [ 676.247077] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.247399] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.249503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.249503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.249503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.249503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.437082] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2645787-f0c6-445b-afb0-d7c9acc45e6c: rpc.has_security_group_logging(os_id): False [ 676.455842] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.455996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.456600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.456600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.456600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.456829] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.456829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.456971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.457041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.457095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.457317] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.457437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.457502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.457646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.457721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.457938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.458066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.458130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.458275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.458361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.458448] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 676.492536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.492737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.492737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.492966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.493057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.493099] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c already deleted. [ 676.493181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.528410] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.528883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.528883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.528883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.529933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.544722] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 677.008824] env[65455]: INFO networking_nsxv3.common.synchronization [req-8c52a118-05a8-4690-9dea-564964788827 req-4369056e-ce21-4cf4-bed3-e6d253ac6bfb service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 677.009187] env[65455]: INFO networking_nsxv3.common.synchronization [req-8c52a118-05a8-4690-9dea-564964788827 req-4369056e-ce21-4cf4-bed3-e6d253ac6bfb service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 677.009187] env[65455]: INFO networking_nsxv3.common.synchronization [req-8c52a118-05a8-4690-9dea-564964788827 req-4369056e-ce21-4cf4-bed3-e6d253ac6bfb service nova] Enqueued Resource ID: 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 with Priority: HIGHEST for action port [ 677.009468] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 677.009659] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 677.009775] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 with Priority: HIGHEST for action port [ 677.010728] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.010863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.012272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.012272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.012272] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.012272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.012726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.012726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.012726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.012848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.012899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.012938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.015965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.015965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.015965] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.015965] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.015965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.015965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.015965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.015965] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4884a7ae-ed1c-4db2-b880-21ca0f4b1865',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.516945] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.518154] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.518154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.518439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 with status ACTIVE [ 677.518488] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.518600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.520561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.520561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.520561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.520561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4884a7ae-ed1c-4db2-b880-21ca0f4b1865 is going to be updated. [ 677.561733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.561733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.561960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.562053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.562213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.562392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4884a7ae-ed1c-4db2-b880-21ca0f4b1865" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.803501] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 677.803501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.019741] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.523325] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.523325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.523325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.523325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.523325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.523325] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be created. [ 678.555791] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.555985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.556075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.556467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.556535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.569683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: UNINITIALIZED for 2s [ 678.569683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 678.569683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.781262] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fdf0944-f7c0-493c-8439-8b0410e702ff req-31efd351-a3a1-4985-b245-46973e056833 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 678.787741] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 678.788923] env[65455]: INFO networking_nsxv3.common.synchronization [None req-489cd136-0d9c-4aee-bbbd-504756b07adf None None] Enqueued Resource ID: c8ad16dc-9f30-4252-9cf6-539e2a72a421 with Priority: HIGHEST for action port [ 678.789688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.789817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.789943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.790240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.790404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.790773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.790773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.790773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.790931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.790931] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.792868] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ad16dc-9f30-4252-9cf6-539e2a72a421 with Priority: HIGHEST for action port [ 678.795958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8ad16dc-9f30-4252-9cf6-539e2a72a421 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.795958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8ad16dc-9f30-4252-9cf6-539e2a72a421" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.796193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8ad16dc-9f30-4252-9cf6-539e2a72a421" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.798037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8ad16dc-9f30-4252-9cf6-539e2a72a421" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.798037] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8ad16dc-9f30-4252-9cf6-539e2a72a421',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.300033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300033] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 already deleted. [ 679.300033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.300033] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8ad16dc-9f30-4252-9cf6-539e2a72a421 [ 679.300934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.300934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.300934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.300934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.302126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.302126] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8ad16dc-9f30-4252-9cf6-539e2a72a421 already deleted. [ 679.302126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8ad16dc-9f30-4252-9cf6-539e2a72a421" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.535188] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.539021] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.539021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.539021] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.539021] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.539021] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.539565] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.539565] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.539692] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.539864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.563177] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.563613] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.563613] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.563783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.565649] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-c4fa720f-5946-41cb-a30b-4d63add75c97 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.565649] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.565649] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.565649] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.565649] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4fa720f-5946-41cb-a30b-4d63add75c97',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.068114] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.068482] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.068718] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.069060] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.069206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.069358] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port c4fa720f-5946-41cb-a30b-4d63add75c97 not found, creating... [ 680.069626] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.070326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.070326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.070326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.070493] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.070871] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.071574] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.071719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.071979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.072130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.072323] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: c4fa720f-5946-41cb-a30b-4d63add75c97 is going to be created. [ 680.100052] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.100551] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.100650] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.100886] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.101141] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.101467] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.583348] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 680.583699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.584550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.584550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.584550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.584550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.584550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.584858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.584858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.584858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.584975] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.885305] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fdf0944-f7c0-493c-8439-8b0410e702ff req-d9950849-fa9a-4e81-ba3b-a67808bbb87a service nova] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_rules [ 680.885465] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fdf0944-f7c0-493c-8439-8b0410e702ff req-d9950849-fa9a-4e81-ba3b-a67808bbb87a service nova] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 680.885604] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fdf0944-f7c0-493c-8439-8b0410e702ff req-d9950849-fa9a-4e81-ba3b-a67808bbb87a service nova] Enqueued Resource ID: c4fa720f-5946-41cb-a30b-4d63add75c97 with Priority: HIGHEST for action port [ 680.886112] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_rules [ 680.886275] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 680.886410] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4fa720f-5946-41cb-a30b-4d63add75c97 with Priority: HIGHEST for action port [ 680.886695] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.886823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.886892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.887420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.887535] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.888569] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.889685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.889818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.890403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.890403] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.891431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.892237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.892446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.892747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.892871] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.894475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4fa720f-5946-41cb-a30b-4d63add75c97 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.894618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.894708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.895124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.895200] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4fa720f-5946-41cb-a30b-4d63add75c97',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.090745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.090745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.090745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.090745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.090745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.090745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.090745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.094360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.094360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.094360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.094360] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.397905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.398120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.398549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.400081] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4fa720f-5946-41cb-a30b-4d63add75c97 with status ACTIVE [ 681.400339] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.400466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.400534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.400824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.400920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.401217] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.401308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.401384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.401597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.401658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.401850] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.401954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.402106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.403055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.403055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.403055] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4fa720f-5946-41cb-a30b-4d63add75c97 is going to be updated. [ 681.428037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.428037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.428037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.428037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.428037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.428037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4fa720f-5946-41cb-a30b-4d63add75c97" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.595724] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5: rpc.has_security_group_logging(os_id): False [ 681.618485] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.618620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.618816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.619352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.619459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.619662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.620046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.620046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.620046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.620046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.620498] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.620498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.620498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.620854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.620933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.621132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.621254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.621324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.621495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.621593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.621826] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be created. [ 681.699117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.699286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.699374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.699609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.700035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.714543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 681.905784] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.087247] env[65455]: INFO networking_nsxv3.common.synchronization [None req-070f9272-aada-420c-8f5e-896c8664d6da None None] Enqueued Resource ID: 46a7f03a-6b39-4c23-82cd-9c1870d9db53 with Priority: HIGHEST for action port [ 682.087247] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a7f03a-6b39-4c23-82cd-9c1870d9db53 with Priority: HIGHEST for action port [ 682.087247] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a7f03a-6b39-4c23-82cd-9c1870d9db53 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.087247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a7f03a-6b39-4c23-82cd-9c1870d9db53" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.087247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a7f03a-6b39-4c23-82cd-9c1870d9db53" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.089273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a7f03a-6b39-4c23-82cd-9c1870d9db53" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.089273] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a7f03a-6b39-4c23-82cd-9c1870d9db53',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.136490] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6392656-20c4-451d-a15b-e1dbec411184 req-0414ad93-50d5-4e17-b659-efd87dfbdd99 tempest-ServerMetadataNegativeTestJSON-2103020927 tempest-ServerMetadataNegativeTestJSON-2103020927-project-member] Enqueued Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 682.136490] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 682.136961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.137489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.137603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.137909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.138184] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.138338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.138433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.138639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.138765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.139588] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.409530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.409733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.409733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.410056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.410204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.410356] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be created. [ 682.442233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.442468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.442468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.442710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.442900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.453646] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: UNINITIALIZED for 2s [ 682.591276] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46a7f03a-6b39-4c23-82cd-9c1870d9db53 [ 682.591276] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.591276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.591550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.591550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.591639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.594604] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46a7f03a-6b39-4c23-82cd-9c1870d9db53 already deleted. [ 682.594604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a7f03a-6b39-4c23-82cd-9c1870d9db53" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.641463] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.641463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.641463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.642452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.642452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.643359] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.643359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.643359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.643359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.643616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.643616] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 already deleted. [ 682.643616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.772894] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-532 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-532" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-532" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-532" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.777674] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.777674] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.777674] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.777674] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.777674] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.777674] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.777674] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.777674] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.777674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.804023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.804023] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.804023] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.804023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-532" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.804023] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-27e845fa-7876-41ba-9d68-fe15eeb49b57 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.804023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.804023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.804023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.804023] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e845fa-7876-41ba-9d68-fe15eeb49b57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.913217] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7e9e8685-5647-44c7-b323-3809d9469481 None None] Enqueued Resource ID: 8117ee86-cdc7-402a-9e03-719958bf9fb5 with Priority: HIGHEST for action port [ 682.913715] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8117ee86-cdc7-402a-9e03-719958bf9fb5 with Priority: HIGHEST for action port [ 682.914052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8117ee86-cdc7-402a-9e03-719958bf9fb5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.914157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8117ee86-cdc7-402a-9e03-719958bf9fb5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.914337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8117ee86-cdc7-402a-9e03-719958bf9fb5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.914481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8117ee86-cdc7-402a-9e03-719958bf9fb5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.914562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8117ee86-cdc7-402a-9e03-719958bf9fb5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.309681] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.309932] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.310036] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.310327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.310500] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.310678] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 27e845fa-7876-41ba-9d68-fe15eeb49b57 not found, creating... [ 683.310967] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.311142] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.311266] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.311562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.311706] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.311993] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.312159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.312297] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.312521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.312653] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.312790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 27e845fa-7876-41ba-9d68-fe15eeb49b57 is going to be created. [ 683.341863] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.342135] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.342207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.342458] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.342697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.342938] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.417686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8117ee86-cdc7-402a-9e03-719958bf9fb5 [ 683.418734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.419382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.419382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.419559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.419646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.419791] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8117ee86-cdc7-402a-9e03-719958bf9fb5 already deleted. [ 683.419937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8117ee86-cdc7-402a-9e03-719958bf9fb5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.607969] env[65455]: INFO networking_nsxv3.common.synchronization [req-ddf887c7-b5cf-45df-ba84-68e5e8b4a487 req-dad98171-1345-4e83-b8cf-6f0db906f56d tempest-ServerDiagnosticsNegativeTest-230203940 tempest-ServerDiagnosticsNegativeTest-230203940-project-member] Enqueued Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 683.609147] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0ddf7c7-f7d9-457a-834f-979355b01964 with Priority: HIGHEST for action security_group_members [ 683.609147] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0ddf7c7-f7d9-457a-834f-979355b01964 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.609147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.609147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.609414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.609583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.609846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.610061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.610270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.610397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.610521] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0ddf7c7-f7d9-457a-834f-979355b01964',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.729345] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 683.729691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.082653] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6392656-20c4-451d-a15b-e1dbec411184 req-269b49d1-ed28-46b0-892a-db92cbdf6a70 service nova] Enqueued Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_rules [ 684.082814] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6392656-20c4-451d-a15b-e1dbec411184 req-269b49d1-ed28-46b0-892a-db92cbdf6a70 service nova] Enqueued Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 684.082941] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6392656-20c4-451d-a15b-e1dbec411184 req-269b49d1-ed28-46b0-892a-db92cbdf6a70 service nova] Enqueued Resource ID: 27e845fa-7876-41ba-9d68-fe15eeb49b57 with Priority: HIGHEST for action port [ 684.083197] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_rules [ 684.083326] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 684.083421] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27e845fa-7876-41ba-9d68-fe15eeb49b57 with Priority: HIGHEST for action port [ 684.084177] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.084309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.084375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.084629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.084711] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.085637] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.085755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.085822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.085988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.086222] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.086321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.086406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.086526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.086806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.086903] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.087762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-27e845fa-7876-41ba-9d68-fe15eeb49b57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.087885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.087885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.088014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.088078] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e845fa-7876-41ba-9d68-fe15eeb49b57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.112272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.112693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.112769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.114505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.114656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.114847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.114947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.115022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.115204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.115287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.115374] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ddf7c7-f7d9-457a-834f-979355b01964 is going to be updated. [ 684.150624] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.151431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.151431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.151431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.151770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.176965] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: IN_PROGRESS for 2s [ 684.380639] env[65455]: INFO networking_nsxv3.common.synchronization [req-36499a68-f2c0-441d-9255-0e1c2bd193e1 req-73b0a1b6-a134-4d4f-a188-3d581dcfbc24 tempest-TenantUsagesTestJSON-1707294520 tempest-TenantUsagesTestJSON-1707294520-project-member] Enqueued Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 684.380639] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGHEST for action security_group_members [ 684.381601] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.381752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.381818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.382021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.382185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.382325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.382380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.383387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.383527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.383634] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.464825] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 684.465216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.465438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.465692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.465856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.465972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.466072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.466312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.466398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.466512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.466712] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.590449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.590449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.590449] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.590898] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27e845fa-7876-41ba-9d68-fe15eeb49b57 with status ACTIVE [ 684.591873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.591873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.591873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.592295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.592295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.592295] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.592406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.592406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.592513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.593485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.593485] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27e845fa-7876-41ba-9d68-fe15eeb49b57 is going to be updated. [ 684.625789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.625961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.626092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.626392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.626580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.628202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27e845fa-7876-41ba-9d68-fe15eeb49b57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.890564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.890913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.890913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.890913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.921527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.921527] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.921527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.921527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.921843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.921843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.921843] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 is going to be updated. [ 684.952958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.953197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.953197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.953453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.953548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.963198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: IN_PROGRESS for 2s [ 684.969781] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.969998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.969998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.970219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.970378] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.970503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.970561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.970670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.970750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.970885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.971157] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.971157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.971290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.971328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.971466] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.971559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.971741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.972120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.972120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.972242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.972277] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.097913] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.474674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10c4ff11-5e8b-4540-903a-abb548417d57: rpc.has_security_group_logging(os_id): False [ 685.497876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.498110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.498110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.498353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.498446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.498668] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.498793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.498853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.499026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.499104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.499303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.499394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.499448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.499592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.499666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.499847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.500040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.500040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.501981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.501981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.501981] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be created. [ 685.567966] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.567966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.567966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.567966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.567966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.580657] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 685.600586] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.605242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.605242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.605242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.605242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.605242] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 is going to be created. [ 685.642307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.642528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.642729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.642986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.643244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.665167] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: UNINITIALIZED for 2s [ 685.684907] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f4d28175-7940-4357-bf1c-3cff3cd5e02e None None] Enqueued Resource ID: e465074d-bb8a-4f7c-be31-5f060bab4ed6 with Priority: HIGHEST for action port [ 685.685742] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e465074d-bb8a-4f7c-be31-5f060bab4ed6 with Priority: HIGHEST for action port [ 685.686206] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e465074d-bb8a-4f7c-be31-5f060bab4ed6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.686389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e465074d-bb8a-4f7c-be31-5f060bab4ed6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.686514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e465074d-bb8a-4f7c-be31-5f060bab4ed6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.686807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e465074d-bb8a-4f7c-be31-5f060bab4ed6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.686915] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e465074d-bb8a-4f7c-be31-5f060bab4ed6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.187565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0ddf7c7-f7d9-457a-834f-979355b01964 in Status: SUCCESS [ 686.187948] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0ddf7c7-f7d9-457a-834f-979355b01964 deletion is rescheduled due to dependency. [ 686.188222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0ddf7c7-f7d9-457a-834f-979355b01964" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.193048] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e465074d-bb8a-4f7c-be31-5f060bab4ed6 [ 686.193048] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.193285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.193409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.193685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.193805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.193942] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e465074d-bb8a-4f7c-be31-5f060bab4ed6 already deleted. [ 686.194085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e465074d-bb8a-4f7c-be31-5f060bab4ed6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.975028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 in Status: SUCCESS [ 686.975028] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 deletion is rescheduled due to dependency. [ 686.975028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.508316] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1c2e6bac-bef0-4a30-9201-73b6f8343876 tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 687.509018] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 687.510921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.510921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.510921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.511192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.511265] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.597098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 687.597734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.671018] env[65455]: INFO networking_nsxv3.common.synchronization [None req-2b36c5e3-fe3f-4a06-80c0-a42f964182c8 tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 687.672176] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 687.673356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.674088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.682223] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: SUCCESS [ 687.682385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.682625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.682967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.683245] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.683424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.683528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.683779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.683915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.684319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.684541] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.037337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.037541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.037620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.037894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.038039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.038140] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef already deleted. [ 688.038361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.038474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.038668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.038725] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.188570] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.188813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.188813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.189065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.189205] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.189308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.189379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.189521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.189605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.189691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.189837] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.189933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.189991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.190199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.190312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.190403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.190460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.190591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.190672] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.190754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.190843] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.511371] env[65455]: INFO networking_nsxv3.common.synchronization [req-0b1f1505-7fc6-42ad-af5b-e3f8b6943d7d req-8315ac15-513a-43cb-8fcf-fc0a2a31a61a tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 688.512242] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 688.512548] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.512681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.512749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.512953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.514090] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.514331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.514424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.514556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.514646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.514742] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.563478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.563478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.563478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.563478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.563478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.563478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef already deleted. [ 688.563478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.694731] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8950d72-cdfa-4b89-babf-49c50bce2b96: rpc.has_security_group_logging(os_id): False [ 688.714234] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.716051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.716051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.716051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.716649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.716649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.716649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.716649] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.716649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.716841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.716841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.716915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.716968] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 is going to be created. [ 688.785262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.785440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.785513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.785689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.785862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.798260] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: IN_PROGRESS for 2s [ 689.017594] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.017755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.017887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.018082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.038693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.040189] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.040189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.040189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.040189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.040420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.040420] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 689.084356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.084582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.084638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.085087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.085263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.095567] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 689.349590] env[65455]: INFO networking_nsxv3.common.synchronization [req-bcb6ab2a-fa9e-4cb9-a0de-9e8fa09a9f4b req-561fb22f-2e4c-41dc-a305-4dcb222054b2 tempest-VolumesAdminNegativeTest-2091318921 tempest-VolumesAdminNegativeTest-2091318921-project-member] Enqueued Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 689.350145] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGHEST for action security_group_members [ 689.351176] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.351176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.351325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.353047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.353047] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.353047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.353047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.353047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.353322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.353322] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.854982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.855344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.855344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.855692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.855781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.857151] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.857467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.857467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.857809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.857988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.858203] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 is going to be updated. [ 689.894293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.894524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.894579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.894780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.895054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.911040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: IN_PROGRESS for 2s [ 690.811586] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: SUCCESS [ 690.814212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.909291] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e715d6a9-027a-4cfa-96bb-fcf272fa16a0 None None] Enqueued Resource ID: bf83e709-e92b-437f-a2cf-518f492facfc with Priority: HIGHEST for action port [ 690.909291] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf83e709-e92b-437f-a2cf-518f492facfc with Priority: HIGHEST for action port [ 690.909679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf83e709-e92b-437f-a2cf-518f492facfc taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.909679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf83e709-e92b-437f-a2cf-518f492facfc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.909789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf83e709-e92b-437f-a2cf-518f492facfc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.911857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf83e709-e92b-437f-a2cf-518f492facfc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.911857] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf83e709-e92b-437f-a2cf-518f492facfc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.108148] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 691.111322] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 691.111322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.413125] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf83e709-e92b-437f-a2cf-518f492facfc [ 691.413440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.413594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.413663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.413869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.413951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.414055] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf83e709-e92b-437f-a2cf-518f492facfc already deleted. [ 691.414235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf83e709-e92b-437f-a2cf-518f492facfc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.922276] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1cb582a8-be40-4b11-ac01-813b4c480718 in Status: SUCCESS [ 691.922577] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 deletion is rescheduled due to dependency. [ 691.922621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.654936] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5f9bd2b0-4a2f-498e-9336-4e9c972b6ad2 None None] Enqueued Resource ID: ac4f1c42-89f9-4da5-a298-9f07136aded0 with Priority: HIGHEST for action port [ 693.656930] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4f1c42-89f9-4da5-a298-9f07136aded0 with Priority: HIGHEST for action port [ 693.656930] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac4f1c42-89f9-4da5-a298-9f07136aded0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.656930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac4f1c42-89f9-4da5-a298-9f07136aded0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.657733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac4f1c42-89f9-4da5-a298-9f07136aded0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.657891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac4f1c42-89f9-4da5-a298-9f07136aded0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.657977] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4f1c42-89f9-4da5-a298-9f07136aded0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.688425] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb0a1aed-a7c2-421e-8436-105692d4d00d req-6ffc7b33-d1c9-4dfc-81c2-44847f49fe79 tempest-ServerRescueTestJSONUnderV235-422419096 tempest-ServerRescueTestJSONUnderV235-422419096-project-member] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 693.689594] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGHEST for action security_group_members [ 693.689988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.690135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.690205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.690400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.690554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.690680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.690752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.690855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.690933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.691955] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.911323] env[65455]: INFO networking_nsxv3.common.synchronization [req-dc306910-2622-4456-8bb4-b85e8de0cb20 req-5ecea726-a450-4232-bb01-51edeaa57444 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 693.911323] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 693.911323] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.911323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.912584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.912997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.913541] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.913784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.915546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.915546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.915546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.915546] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.162387] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac4f1c42-89f9-4da5-a298-9f07136aded0 [ 694.162387] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.162387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.162387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.162387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.162387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.162387] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac4f1c42-89f9-4da5-a298-9f07136aded0 already deleted. [ 694.162387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac4f1c42-89f9-4da5-a298-9f07136aded0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.186785] env[65455]: INFO networking_nsxv3.common.synchronization [req-dc306910-2622-4456-8bb4-b85e8de0cb20 req-ec331829-2965-4bb7-ba7a-36b0bb3996de tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 694.187388] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 694.187708] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.187895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.193471] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.194989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.194989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.194989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.194989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.194989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.194989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.195401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.195657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.195740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.195867] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be updated. [ 694.232884] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.233130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.233130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.233356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.233520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.243338] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: IN_PROGRESS for 2s [ 694.418268] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.475808] env[65455]: INFO networking_nsxv3.common.synchronization [req-dc306910-2622-4456-8bb4-b85e8de0cb20 req-eea5ce32-0c2e-4e6b-823e-eab8ca95e22d tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 694.478265] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 694.478669] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.478812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.920432] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.031688] env[65455]: INFO networking_nsxv3.common.synchronization [req-2e595a5c-caaa-498a-b907-bdffe24567ba req-82a5ca1d-9d9b-4cac-b52b-4e16a93c2557 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 695.032491] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 695.032712] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.032842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.032908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.033290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.033828] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.033985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.034110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.034326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.034931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.034931] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.422848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.423013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.423093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.423312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.423402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.423503] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 695.452719] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.452887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.452887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.453190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.454051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.462817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 695.537770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.537987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.538084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.538317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.538437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.539308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.540759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.540759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.540759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.540759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.540759] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c already deleted. [ 695.540759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.729789] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.730103] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-394" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.730206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-394" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.730561] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-394" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.730837] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.730992] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.731117] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.731719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.731719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.731907] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.732015] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.732181] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.732258] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.732318] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.732408] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.732978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.754018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.754195] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.754358] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.754563] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-394" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.754891] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-45447620-7790-4a01-ba84-10cddc5ed4bf taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.755070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.755183] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.755522] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.755655] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45447620-7790-4a01-ba84-10cddc5ed4bf',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.256904] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 in Status: SUCCESS [ 696.257303] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 deletion is rescheduled due to dependency. [ 696.257303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.257738] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.257926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.258058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.258361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.258523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.258671] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 45447620-7790-4a01-ba84-10cddc5ed4bf not found, creating... [ 696.258927] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.260297] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.260431] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.260679] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.261334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.261844] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.262031] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.262161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.262371] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.262505] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.262644] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 45447620-7790-4a01-ba84-10cddc5ed4bf is going to be created. [ 696.286019] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.286019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.286019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.286019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.286019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.286019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.997284] env[65455]: INFO networking_nsxv3.common.synchronization [req-2e595a5c-caaa-498a-b907-bdffe24567ba req-20a3655f-ba3e-4ff2-99c8-258bcec221c2 service nova] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 696.997481] env[65455]: INFO networking_nsxv3.common.synchronization [req-2e595a5c-caaa-498a-b907-bdffe24567ba req-20a3655f-ba3e-4ff2-99c8-258bcec221c2 service nova] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 696.997622] env[65455]: INFO networking_nsxv3.common.synchronization [req-2e595a5c-caaa-498a-b907-bdffe24567ba req-20a3655f-ba3e-4ff2-99c8-258bcec221c2 service nova] Enqueued Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 696.998207] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 696.998543] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 696.998543] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 696.998703] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.998821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.998899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.999125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.999211] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.000400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.000520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.000583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.000716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.000879] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.000950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.001016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.001169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.001253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.001344] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.002176] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-45447620-7790-4a01-ba84-10cddc5ed4bf taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.002269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.002310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.002568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.003603] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45447620-7790-4a01-ba84-10cddc5ed4bf',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.473087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 697.473356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.473481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.473694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.474158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.474158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.474379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.474379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.474461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.474501] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.504692] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.505991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.506143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.506640] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45447620-7790-4a01-ba84-10cddc5ed4bf with status ACTIVE [ 697.506640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.506640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.506640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.506983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.506983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.507085] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.507248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.507248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.507368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.507440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.508720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.508720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.508720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.508720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.508720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.509383] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45447620-7790-4a01-ba84-10cddc5ed4bf is going to be updated. [ 697.532158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.532325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.532398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.532583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.532695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.532846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.670275] env[65455]: INFO networking_nsxv3.common.synchronization [req-69c718d4-5154-4b23-87ff-c07f18688c86 req-10c40eb8-e581-4379-86bf-f21ba12fd3b9 tempest-ServerExternalEventsTest-1750897218 tempest-ServerExternalEventsTest-1750897218-project-member] Enqueued Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 697.671128] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 697.671468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.671627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.673126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.673126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.673126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.673369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.673369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.673369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.673525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.673525] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.979026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.979026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.979026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.979026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 698.007979] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.008083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.008130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.008338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.008525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.012159] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.017478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 698.129826] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.129826] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.129826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.129826] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.129826] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.129826] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.129826] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.130564] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.130564] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.130564] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.150240] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.150399] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.150538] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.150718] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.151464] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.151464] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.151464] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.151752] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.151752] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd72ea57-5fea-45bb-9575-a74cd2b5f9fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.176796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.176983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.177075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.177295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.177377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.177572] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.177663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.177720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.177970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.177970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.178141] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a6023d-5c33-4db0-b5c2-37c37091322f already deleted. [ 698.178141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.517085] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.517459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.517459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.517556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.517598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.517685] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be created. [ 698.542412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.542629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.542629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.542836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.543079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.555966] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: UNINITIALIZED for 2s [ 698.655743] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.655743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.655743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.655743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.655743] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.655743] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port dd72ea57-5fea-45bb-9575-a74cd2b5f9fd not found, creating... [ 698.656366] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.656366] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.656366] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.656503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.656543] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.656828] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.657051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.657200] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.657408] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.657532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.657665] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: dd72ea57-5fea-45bb-9575-a74cd2b5f9fd is going to be created. [ 698.684483] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.684700] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.684800] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.685077] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.685309] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.685638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.428403] env[65455]: INFO networking_nsxv3.common.synchronization [None req-3a89142b-9a0d-4b08-94bc-59a26de48f62 None None] Enqueued Resource ID: 98343665-e385-41c9-a088-c2fcd9c87fef with Priority: HIGHEST for action port [ 699.428403] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98343665-e385-41c9-a088-c2fcd9c87fef with Priority: HIGHEST for action port [ 699.429519] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-98343665-e385-41c9-a088-c2fcd9c87fef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.429670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98343665-e385-41c9-a088-c2fcd9c87fef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.429764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98343665-e385-41c9-a088-c2fcd9c87fef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.430063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98343665-e385-41c9-a088-c2fcd9c87fef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.431056] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98343665-e385-41c9-a088-c2fcd9c87fef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.432402] env[65455]: INFO networking_nsxv3.common.synchronization [req-69c718d4-5154-4b23-87ff-c07f18688c86 req-08f1df66-ce80-4753-998f-57afbed2f73a service nova] Enqueued Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_rules [ 699.432632] env[65455]: INFO networking_nsxv3.common.synchronization [req-69c718d4-5154-4b23-87ff-c07f18688c86 req-08f1df66-ce80-4753-998f-57afbed2f73a service nova] Enqueued Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 699.432703] env[65455]: INFO networking_nsxv3.common.synchronization [req-69c718d4-5154-4b23-87ff-c07f18688c86 req-08f1df66-ce80-4753-998f-57afbed2f73a service nova] Enqueued Resource ID: dd72ea57-5fea-45bb-9575-a74cd2b5f9fd with Priority: HIGHEST for action port [ 699.433391] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_rules [ 699.433515] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 699.433614] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd72ea57-5fea-45bb-9575-a74cd2b5f9fd with Priority: HIGHEST for action port [ 699.433874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.435242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.435451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.435752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.435869] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.437199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.437199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.437199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.437514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.437709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.437838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.437926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.438119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.438240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.438358] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.439512] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.439662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.439782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.439979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.440096] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd72ea57-5fea-45bb-9575-a74cd2b5f9fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.934218] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98343665-e385-41c9-a088-c2fcd9c87fef [ 699.935025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.935025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.935025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.935025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.935265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.935695] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98343665-e385-41c9-a088-c2fcd9c87fef already deleted. [ 699.935695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98343665-e385-41c9-a088-c2fcd9c87fef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.945096] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.945943] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.946089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.948350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd72ea57-5fea-45bb-9575-a74cd2b5f9fd with status ACTIVE [ 699.948350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.948350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.948350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.948350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.948978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.948978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd72ea57-5fea-45bb-9575-a74cd2b5f9fd is going to be updated. [ 699.972179] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.972352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.972401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.972724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.973817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.973817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd72ea57-5fea-45bb-9575-a74cd2b5f9fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.028618] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 700.028805] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c deletion is rescheduled due to dependency. [ 700.028924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.029109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.029333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.029518] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.029661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.029730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.029888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.029966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.030074] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.451531] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.533249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.533394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.533461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.533834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.533834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.533947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.534360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.534360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.534360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.534360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.534530] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 700.576264] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.576264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.576264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.576264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.576264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.576863] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 700.577276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.580860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.580970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.581192] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.581319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.581384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.581523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.581588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.581679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.581769] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.589178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 700.956558] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.956879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.956879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.957014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.957043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.957121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a6023d-5c33-4db0-b5c2-37c37091322f is going to be created. [ 700.964090] env[65455]: INFO networking_nsxv3.common.synchronization [req-d4b39c75-3677-40f4-93fc-5ccf25aeb879 req-edadf6c4-7ee3-4648-9dd6-0a96018350a8 tempest-DeleteServersAdminTestJSON-968335089 tempest-DeleteServersAdminTestJSON-968335089-project-member] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 700.964668] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGHEST for action security_group_members [ 700.964969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.965102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.965196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.965392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.965565] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.965667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.965729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.965886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.965983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.969680] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.987603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.987733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.987799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.989064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.989435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.002771] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: UNINITIALIZED for 2s [ 701.085653] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.473312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.473535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.473634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.473904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.474080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.474349] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.474697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.475881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.475881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.475881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.475881] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be updated. [ 701.508977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.508977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.508977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.508977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.508977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.518228] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: IN_PROGRESS for 2s [ 701.589686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c: rpc.has_security_group_logging(os_id): False [ 701.619321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.619491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.619533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.619766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.619852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.620144] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.620255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.620319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.620545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.620612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.620665] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be created. [ 701.705624] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.705824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.705824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.706125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.706377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.719458] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 702.055728] env[65455]: INFO networking_nsxv3.common.synchronization [None req-04311e93-bf8c-4c4b-b61b-db7290ba7d18 None None] Enqueued Resource ID: e71bef9c-db04-4876-adf3-26115e8dcbc9 with Priority: HIGHEST for action port [ 702.057244] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71bef9c-db04-4876-adf3-26115e8dcbc9 with Priority: HIGHEST for action port [ 702.057244] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e71bef9c-db04-4876-adf3-26115e8dcbc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.057244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e71bef9c-db04-4876-adf3-26115e8dcbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.058133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e71bef9c-db04-4876-adf3-26115e8dcbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.058133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e71bef9c-db04-4876-adf3-26115e8dcbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.058133] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e71bef9c-db04-4876-adf3-26115e8dcbc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.560619] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e71bef9c-db04-4876-adf3-26115e8dcbc9 [ 702.560963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.561282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.561415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.561892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.562689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.562846] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e71bef9c-db04-4876-adf3-26115e8dcbc9 already deleted. [ 702.563110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e71bef9c-db04-4876-adf3-26115e8dcbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.604456] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 702.604572] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c deletion is rescheduled due to dependency. [ 702.604702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020555] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: SUCCESS [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020555] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020555] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.525374] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.525718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.525718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.528561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.528789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.528916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.528987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.529375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.529375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.529537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.529624] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.529751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.529821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.530052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.530225] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.530336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.530472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.530588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.530683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.530771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.530888] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.532612] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 in Status: SUCCESS [ 703.532807] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 deletion is rescheduled due to dependency. [ 703.532930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.736815] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 703.737099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.034463] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4a6023d-5c33-4db0-b5c2-37c37091322f: rpc.has_security_group_logging(os_id): False [ 704.056428] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.056939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.057081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.057389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.057448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.057689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.057799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.057872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.058064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.058149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.058338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.058434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.058495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.059612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.059767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.060079] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.060858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.061132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.061733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.061943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.062175] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4a6023d-5c33-4db0-b5c2-37c37091322f is going to be created. [ 704.207626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.207877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.208540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.208540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.208617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.226884] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: IN_PROGRESS for 2s [ 705.037639] env[65455]: INFO networking_nsxv3.common.synchronization [req-8eae1edf-f336-4949-8800-cfccb0be38fc req-4247ab13-38f2-41f0-8e7f-6eaaae032054 tempest-FloatingIPsAssociationNegativeTestJSON-2086781852 tempest-FloatingIPsAssociationNegativeTestJSON-2086781852-project-member] Enqueued Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 705.039415] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGHEST for action security_group_members [ 705.039415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.039415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.039415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.039415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.043172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.043626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.044039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.044307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.044441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.044578] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.303484] env[65455]: INFO networking_nsxv3.common.synchronization [req-183a924c-3cb9-4256-bad5-b1329d0fc69f req-238f1f52-8d4a-45bd-a9fa-6c17f46d8bfd tempest-FloatingIPsAssociationTestJSON-414106725 tempest-FloatingIPsAssociationTestJSON-414106725-project-member] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 705.304171] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 705.306155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.306155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.306155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.306155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.309744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.309744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.309744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.309744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.309744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.309744] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.458984] env[65455]: INFO networking_nsxv3.common.synchronization [req-721860ac-40f7-4d17-8835-7c034e6631b4 req-6a2e9ca2-7134-466d-a3df-d83824c09d4e tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 705.459534] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 705.459833] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.459953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.460015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.460297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.460446] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.460545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.460609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.460775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.460857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.460948] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.546991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.546991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.547412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.547412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.574896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.575211] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.575341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.575410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.575621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.575712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.575884] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad is going to be updated. [ 705.612180] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.612355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.612444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.612854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.613014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.622503] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: IN_PROGRESS for 2s [ 705.815288] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.964096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.964262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.964321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.964538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.964635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.964816] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.964914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.964974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.965138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.965218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.965299] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 705.994249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.994249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.994249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.994249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.994249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.002730] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 706.015422] env[65455]: INFO networking_nsxv3.common.synchronization [req-e624476c-72a5-499d-8b69-65fb1598fc71 req-c7e20e0b-f0c4-4502-b41d-1ce5653bd2b8 tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: d2e2121a-f0a7-472e-a2cd-4046236de096 with Priority: HIGHEST for action security_group_rules [ 706.015422] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2e2121a-f0a7-472e-a2cd-4046236de096 with Priority: HIGHEST for action security_group_rules [ 706.015422] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2e2121a-f0a7-472e-a2cd-4046236de096 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.015422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2e2121a-f0a7-472e-a2cd-4046236de096" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.015422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2e2121a-f0a7-472e-a2cd-4046236de096" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.015422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2e2121a-f0a7-472e-a2cd-4046236de096" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.015422] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2e2121a-f0a7-472e-a2cd-4046236de096',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.239562] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: SUCCESS [ 706.240566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.317405] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.535434] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.536061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.536306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.536619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.537430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.537430] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2e2121a-f0a7-472e-a2cd-4046236de096 already deleted. [ 706.537430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2e2121a-f0a7-472e-a2cd-4046236de096" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.819792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.819939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.820020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.820289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.820377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.820478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be updated. [ 706.855539] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.855710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.855747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.856203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.856280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.866953] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 707.095623] env[65455]: INFO networking_nsxv3.common.synchronization [req-5b5ccbff-61df-4afe-a547-3d03f869005e req-5d174340-33ad-43d9-b59b-50fcb60ce6b2 tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 707.096284] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 707.096595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.096711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.096776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.096972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.098298] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.098422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.098485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.098668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.098751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.098844] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.602012] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.602386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.602386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.602689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.602935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.603161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.603337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.603439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.603692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.603829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.603992] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 707.637568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a198777-edb2-486c-96fc-27aa5daf59ad in Status: SUCCESS [ 707.637649] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad deletion is rescheduled due to dependency. [ 707.638346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.645883] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.646126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.646212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.646722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.646897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.658491] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 708.015925] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 708.016250] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 708.016387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.449401] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.449665] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.453100] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.453100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.453100] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.453100] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.453100] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.453100] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.453100] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.453100] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.453100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.474304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.474480] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.474670] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.474786] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.475117] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-0df820fd-0f22-464a-b404-199abe634c7a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.475292] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.475406] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.475750] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.475887] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0df820fd-0f22-464a-b404-199abe634c7a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.877068] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 708.877429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.882623] env[65455]: INFO networking_nsxv3.common.synchronization [None req-550e87c8-ecb9-45ab-b903-0eab99f9fdfa None None] Enqueued Resource ID: f744a498-fcb3-418e-aaf9-bb936c667869 with Priority: HIGHEST for action port [ 708.882623] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f744a498-fcb3-418e-aaf9-bb936c667869 with Priority: HIGHEST for action port [ 708.883574] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f744a498-fcb3-418e-aaf9-bb936c667869 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.883574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f744a498-fcb3-418e-aaf9-bb936c667869" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.883574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f744a498-fcb3-418e-aaf9-bb936c667869" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.884248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f744a498-fcb3-418e-aaf9-bb936c667869" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.884248] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f744a498-fcb3-418e-aaf9-bb936c667869',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.978544] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.978806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.978998] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.979361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.979479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.979652] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 0df820fd-0f22-464a-b404-199abe634c7a not found, creating... [ 708.979919] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.980092] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.980209] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.980429] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.980562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.980897] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.981032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.981184] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.982041] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.982041] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.982041] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 0df820fd-0f22-464a-b404-199abe634c7a is going to be created. [ 709.002293] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.002544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.002679] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.002947] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.003182] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.003413] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.387468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f744a498-fcb3-418e-aaf9-bb936c667869 [ 709.387468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.387468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.387468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.388239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.388537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.389051] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f744a498-fcb3-418e-aaf9-bb936c667869 already deleted. [ 709.389051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f744a498-fcb3-418e-aaf9-bb936c667869" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.673122] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 709.673315] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 709.673464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.718036] env[65455]: INFO networking_nsxv3.common.synchronization [req-5b5ccbff-61df-4afe-a547-3d03f869005e req-f8c54c98-6156-40da-bd7f-783a1584a2b9 service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 709.718221] env[65455]: INFO networking_nsxv3.common.synchronization [req-5b5ccbff-61df-4afe-a547-3d03f869005e req-f8c54c98-6156-40da-bd7f-783a1584a2b9 service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 709.718355] env[65455]: INFO networking_nsxv3.common.synchronization [req-5b5ccbff-61df-4afe-a547-3d03f869005e req-f8c54c98-6156-40da-bd7f-783a1584a2b9 service nova] Enqueued Resource ID: 0df820fd-0f22-464a-b404-199abe634c7a with Priority: HIGHEST for action port [ 709.718941] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 709.719647] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 709.719647] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0df820fd-0f22-464a-b404-199abe634c7a with Priority: HIGHEST for action port [ 709.719949] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.720669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.720669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.720842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.720963] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.721969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.722182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.722311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.722554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.722934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.723021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.723120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.723799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.723861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.724136] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.727133] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0df820fd-0f22-464a-b404-199abe634c7a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.728669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.728669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.728669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.728669] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0df820fd-0f22-464a-b404-199abe634c7a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.231396] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0df820fd-0f22-464a-b404-199abe634c7a with status ACTIVE [ 710.231396] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.231855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.231855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.231999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.232166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.232399] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.232546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.232576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.233034] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.235545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.235545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.235545] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0df820fd-0f22-464a-b404-199abe634c7a is going to be updated. [ 710.235545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.235545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.235545] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.265034] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.265034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.265034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.265034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.265034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.265034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0df820fd-0f22-464a-b404-199abe634c7a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.473057] env[65455]: INFO networking_nsxv3.common.synchronization [req-1c1e4b1a-eb1f-49b0-a192-90f7659b4dee req-ac76ea33-c52f-408a-a7d7-ae2c21c895ad tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 710.473057] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 710.473057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.473057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.473057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.473057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.473057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.473057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.473057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.474281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.474281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.474281] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.741954] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.933860] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-30 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.933860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.933860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.933860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.933860] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.933860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.934217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.935025] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.935025] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.935025] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.935025] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.935025] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.935025] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.935363] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.935539] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.935702] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.957104] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.957387] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.957569] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.957787] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.958403] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-cb2447b3-f245-4334-b0f0-3e3307e75604 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.958623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.958988] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.959486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.959731] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb2447b3-f245-4334-b0f0-3e3307e75604',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.975898] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.976076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.976163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.976380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.976465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.976652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.976746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.976804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.976959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.977051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.977175] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef already deleted. [ 710.977581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.245843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.246168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.246276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.246566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.246657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.246756] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 711.278249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.278388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.278451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.278968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.278968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.287148] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 711.359306] env[65455]: INFO networking_nsxv3.common.synchronization [None req-21a8d31e-f220-4aa0-a7c3-c6203e0ec33b None None] Enqueued Resource ID: fdbeef40-2c2b-4f08-b9df-74e3f5106db6 with Priority: HIGHEST for action port [ 711.359575] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbeef40-2c2b-4f08-b9df-74e3f5106db6 with Priority: HIGHEST for action port [ 711.360172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdbeef40-2c2b-4f08-b9df-74e3f5106db6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.360300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdbeef40-2c2b-4f08-b9df-74e3f5106db6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.360369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdbeef40-2c2b-4f08-b9df-74e3f5106db6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.360622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdbeef40-2c2b-4f08-b9df-74e3f5106db6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.360706] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdbeef40-2c2b-4f08-b9df-74e3f5106db6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.467027] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.467027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port cb2447b3-f245-4334-b0f0-3e3307e75604 not found, creating... [ 711.467027] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.467027] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.467532] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.467532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.467532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.467532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.467532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.467894] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: cb2447b3-f245-4334-b0f0-3e3307e75604 is going to be created. [ 711.490697] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.490697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.490697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.490697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.490697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.490697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.864350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdbeef40-2c2b-4f08-b9df-74e3f5106db6 [ 711.864350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.864350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.864350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.864350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.864350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.864350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdbeef40-2c2b-4f08-b9df-74e3f5106db6 already deleted. [ 711.864350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdbeef40-2c2b-4f08-b9df-74e3f5106db6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.226610] env[65455]: INFO networking_nsxv3.common.synchronization [req-1c1e4b1a-eb1f-49b0-a192-90f7659b4dee req-34ca055a-d34a-451a-9c73-6827cef771a6 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 712.226610] env[65455]: INFO networking_nsxv3.common.synchronization [req-1c1e4b1a-eb1f-49b0-a192-90f7659b4dee req-34ca055a-d34a-451a-9c73-6827cef771a6 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 712.226610] env[65455]: INFO networking_nsxv3.common.synchronization [req-1c1e4b1a-eb1f-49b0-a192-90f7659b4dee req-34ca055a-d34a-451a-9c73-6827cef771a6 service nova] Enqueued Resource ID: cb2447b3-f245-4334-b0f0-3e3307e75604 with Priority: HIGHEST for action port [ 712.227069] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 712.227910] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 712.227910] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2447b3-f245-4334-b0f0-3e3307e75604 with Priority: HIGHEST for action port [ 712.227910] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.227910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.227910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.228112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.228183] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.229591] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.229704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.229773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.230048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.230132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.230239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.230323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.230544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.230649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.230745] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.231573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb2447b3-f245-4334-b0f0-3e3307e75604 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.231729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.231834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232098] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb2447b3-f245-4334-b0f0-3e3307e75604',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.734303] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.735786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.735929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.736107] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb2447b3-f245-4334-b0f0-3e3307e75604 with status ACTIVE [ 712.736282] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.736446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.736446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.738428] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.738428] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.738428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.739017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.739017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.739017] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb2447b3-f245-4334-b0f0-3e3307e75604 is going to be updated. [ 712.764307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.764459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.764536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.764745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.764873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.765069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb2447b3-f245-4334-b0f0-3e3307e75604" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.774838] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ec54275-d221-401e-94f4-b3a94a9011ea req-0171bb59-c60f-4f10-857c-d7826498527a tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 712.775931] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 712.776357] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.776532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.776851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.776916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.777093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.777236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.777359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.777574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.777686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.777799] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.230390] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.230902] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.230902] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.231322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.231695] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.231953] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.232210] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.232536] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.232747] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.233182] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.233360] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.233578] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.233725] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.233895] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.234145] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.234340] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.241396] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.255025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.255314] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.255480] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.255690] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.256158] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-6a685d5e-d0f1-464e-9aee-4bdd53823868 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.256377] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.256519] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.256882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.257066] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a685d5e-d0f1-464e-9aee-4bdd53823868',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.281115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.281115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.281644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281851] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 already deleted. [ 713.282132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.300833] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 713.301112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.301335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.301646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.301876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.302535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.302535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.302535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.302535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.302535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.302878] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.743914] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.744273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.744308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.744546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.744631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.744724] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be created. [ 713.759416] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.759701] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.759860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760325] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.760472] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 6a685d5e-d0f1-464e-9aee-4bdd53823868 not found, creating... [ 713.760730] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.760888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.761046] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.761315] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.761405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.762101] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.762101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.762101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.762101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.762543] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.762543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 is going to be created. [ 713.772338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.772497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.772545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.772735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.772890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.783856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: UNINITIALIZED for 2s [ 713.791033] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.791312] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.791481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.791778] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.792042] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.792265] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.806618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.806618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.806618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.806618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.806618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.807138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.807138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.807138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.807138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.807138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.807374] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.807374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.807374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.807522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.807652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.807764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.807814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.808610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.808610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.808610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.808610] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.936388] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c2460d45-b002-4c41-bf36-e80a98f8d0ee None None] Enqueued Resource ID: d575c4cb-7a29-4029-852c-2672d9b270ce with Priority: HIGHEST for action port [ 713.937956] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d575c4cb-7a29-4029-852c-2672d9b270ce with Priority: HIGHEST for action port [ 713.937956] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d575c4cb-7a29-4029-852c-2672d9b270ce taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.937956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d575c4cb-7a29-4029-852c-2672d9b270ce" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.937956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d575c4cb-7a29-4029-852c-2672d9b270ce" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.939479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d575c4cb-7a29-4029-852c-2672d9b270ce" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.939479] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d575c4cb-7a29-4029-852c-2672d9b270ce',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.310961] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 714.331253] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.331253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.331253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.331470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.331499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.331735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.331859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.331925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.332114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.332196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.332388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.332499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.332567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.332716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.332793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.332983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.334273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.334273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.334440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.334489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.334578] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 714.437592] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.437796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.437796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.439543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.440935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.445523] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d575c4cb-7a29-4029-852c-2672d9b270ce [ 714.445748] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.445913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.445982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.446307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.446526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.446693] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d575c4cb-7a29-4029-852c-2672d9b270ce already deleted. [ 714.446791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d575c4cb-7a29-4029-852c-2672d9b270ce" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.465350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 714.554501] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ec54275-d221-401e-94f4-b3a94a9011ea req-1962cc3b-c3fc-4abc-8c58-23e3f173f058 service nova] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 714.554909] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ec54275-d221-401e-94f4-b3a94a9011ea req-1962cc3b-c3fc-4abc-8c58-23e3f173f058 service nova] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 714.555093] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ec54275-d221-401e-94f4-b3a94a9011ea req-1962cc3b-c3fc-4abc-8c58-23e3f173f058 service nova] Enqueued Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 714.555779] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 714.555941] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 714.556093] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 714.556376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.556502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.556573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.556823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.556905] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.557862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.557969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.558065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.558174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.558328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.558436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.558491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.558652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.560343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.560343] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.560343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a685d5e-d0f1-464e-9aee-4bdd53823868 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.560343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.560343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.560343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.560343] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a685d5e-d0f1-464e-9aee-4bdd53823868',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.063207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.063679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.063679] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.064587] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a685d5e-d0f1-464e-9aee-4bdd53823868 with status ACTIVE [ 715.065699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.065699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.065699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.066219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.066219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.066219] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.070709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.070709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.070709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.070709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.070709] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 is going to be updated. [ 715.095825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.095825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.095825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.095825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.095825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.096152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.571141] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.794554] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 715.794818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.795009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.798322] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.798322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.798322] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.820730] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c7bb2fbd-604a-4162-9bc0-4b996e0c6e92 None None] Enqueued Resource ID: 9cb79ea3-9f17-4171-af19-82a025d5ce17 with Priority: HIGHEST for action port [ 715.821530] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cb79ea3-9f17-4171-af19-82a025d5ce17 with Priority: HIGHEST for action port [ 715.822170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cb79ea3-9f17-4171-af19-82a025d5ce17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.822338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cb79ea3-9f17-4171-af19-82a025d5ce17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.822450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cb79ea3-9f17-4171-af19-82a025d5ce17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.822780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cb79ea3-9f17-4171-af19-82a025d5ce17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.822860] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cb79ea3-9f17-4171-af19-82a025d5ce17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.076037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.076037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.076037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.076037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.076037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.076037] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be created. [ 716.103841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.103841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.103841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.103841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.103841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.116285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: UNINITIALIZED for 2s [ 716.303188] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.326098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cb79ea3-9f17-4171-af19-82a025d5ce17 [ 716.326354] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.326503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.326547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.326756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.326843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.326936] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cb79ea3-9f17-4171-af19-82a025d5ce17 already deleted. [ 716.327025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cb79ea3-9f17-4171-af19-82a025d5ce17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.480973] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 716.481288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.498782] env[65455]: INFO networking_nsxv3.common.synchronization [req-8902b953-f58c-4e65-9057-bdd0126ba861 req-f5d2bc5f-8226-4f39-afee-f23a3cfe17c6 tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: 4fbd8451-e0fc-447a-a7a6-c87487dc4ac3 with Priority: HIGHEST for action security_group_rules [ 716.498893] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fbd8451-e0fc-447a-a7a6-c87487dc4ac3 with Priority: HIGHEST for action security_group_rules [ 716.499937] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fbd8451-e0fc-447a-a7a6-c87487dc4ac3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.499937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fbd8451-e0fc-447a-a7a6-c87487dc4ac3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.499937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fbd8451-e0fc-447a-a7a6-c87487dc4ac3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.500396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fbd8451-e0fc-447a-a7a6-c87487dc4ac3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.500477] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fbd8451-e0fc-447a-a7a6-c87487dc4ac3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.810296] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 716.831493] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.831798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.831798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.832094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.832235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.832515] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.832857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.832960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.833184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.833314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.833434] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be created. [ 716.882211] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e0f6e8e4-7d6b-4499-86a5-6d088b4808d3 None None] Enqueued Resource ID: f9557983-f2e8-4c59-9279-b9921e9b5641 with Priority: HIGHEST for action port [ 716.882211] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9557983-f2e8-4c59-9279-b9921e9b5641 with Priority: HIGHEST for action port [ 716.886454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9557983-f2e8-4c59-9279-b9921e9b5641 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.886628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9557983-f2e8-4c59-9279-b9921e9b5641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.886697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9557983-f2e8-4c59-9279-b9921e9b5641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.887056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9557983-f2e8-4c59-9279-b9921e9b5641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.887056] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9557983-f2e8-4c59-9279-b9921e9b5641',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.981261] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.981436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.981508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.981732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.981946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.996994] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 717.034026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.034026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.034026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.034026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.034026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.034026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fbd8451-e0fc-447a-a7a6-c87487dc4ac3 already deleted. [ 717.034026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fbd8451-e0fc-447a-a7a6-c87487dc4ac3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.393079] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9557983-f2e8-4c59-9279-b9921e9b5641 [ 717.393906] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.393906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.393906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.393906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.394736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.394877] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9557983-f2e8-4c59-9279-b9921e9b5641 already deleted. [ 717.394993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9557983-f2e8-4c59-9279-b9921e9b5641" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.129419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 718.129770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.129959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.130197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.130387] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.130501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.130563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.130713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.130786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.130867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.130955] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.633857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.634369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.634551] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.634866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.634951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.635049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.635189] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.635278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.635356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.636881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.636881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.636881] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.916235] env[65455]: INFO networking_nsxv3.common.synchronization [None req-62f71576-f082-43a7-b697-4845919252cf None None] Enqueued Resource ID: 577de2f6-aa01-4dd2-a05a-71fa062adbcd with Priority: HIGHEST for action port [ 718.916235] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 577de2f6-aa01-4dd2-a05a-71fa062adbcd with Priority: HIGHEST for action port [ 718.916235] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-577de2f6-aa01-4dd2-a05a-71fa062adbcd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.916235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-577de2f6-aa01-4dd2-a05a-71fa062adbcd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.916235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-577de2f6-aa01-4dd2-a05a-71fa062adbcd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.916235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-577de2f6-aa01-4dd2-a05a-71fa062adbcd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.916235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('577de2f6-aa01-4dd2-a05a-71fa062adbcd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.009636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 4s [ 719.139090] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 719.165843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.165843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.165843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.165843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.166369] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.166634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.166886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.167216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.167539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.167887] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be created. [ 719.243856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.246024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.246024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.246024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.246024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.260026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 719.419975] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 577de2f6-aa01-4dd2-a05a-71fa062adbcd [ 719.420233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.420379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.420452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.420675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.420772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.420864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:577de2f6-aa01-4dd2-a05a-71fa062adbcd already deleted. [ 719.420947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-577de2f6-aa01-4dd2-a05a-71fa062adbcd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.959291] env[65455]: INFO networking_nsxv3.common.synchronization [None req-90008728-7f8e-4d4f-a269-55eb00ea80c7 tempest-ServerActionsV293TestJSON-876038749 tempest-ServerActionsV293TestJSON-876038749-project-member] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 719.959866] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 719.960085] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.960213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.960587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.960587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.960587] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.068348] env[65455]: INFO networking_nsxv3.common.synchronization [None req-9fcb4f40-1816-44c4-aabd-54213be4f992 tempest-ServerActionsV293TestJSON-876038749 tempest-ServerActionsV293TestJSON-876038749-project-member] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 720.068939] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 720.071308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.072037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.489103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.489103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.489103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.489426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.489426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.489426] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50ff894b-9924-4f71-b210-20859560462d already deleted. [ 720.489545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.490014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.490014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.490014] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.014479] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.014821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.014821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.015012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.015131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.015246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50ff894b-9924-4f71-b210-20859560462d already deleted. [ 721.015333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.026367] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 6s [ 721.272307] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 721.272832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.548565] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f7ab29b-52e8-43b0-864d-da0cf9a6adde req-5a64871b-956f-4c34-aa9b-8e6c867d314a tempest-ServerExternalEventsTest-1750897218 tempest-ServerExternalEventsTest-1750897218-project-member] Enqueued Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 722.549833] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a6023d-5c33-4db0-b5c2-37c37091322f with Priority: HIGHEST for action security_group_members [ 722.550248] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4a6023d-5c33-4db0-b5c2-37c37091322f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.550417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.550510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.550736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.550926] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.551069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.551160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.551359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.551473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.551591] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4a6023d-5c33-4db0-b5c2-37c37091322f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.886030] env[65455]: INFO networking_nsxv3.common.synchronization [req-85ab2e6b-6df1-4d91-9735-aec1c489ca0f req-ef2dc435-5f55-4c90-b96e-83bdedfd355f tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: bec315c8-eeab-41e7-9949-c122e613d204 with Priority: HIGHEST for action security_group_rules [ 722.886030] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec315c8-eeab-41e7-9949-c122e613d204 with Priority: HIGHEST for action security_group_rules [ 722.886030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec315c8-eeab-41e7-9949-c122e613d204 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.886030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec315c8-eeab-41e7-9949-c122e613d204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.886030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec315c8-eeab-41e7-9949-c122e613d204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.889539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec315c8-eeab-41e7-9949-c122e613d204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.893169] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec315c8-eeab-41e7-9949-c122e613d204',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.042557] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 8s [ 723.054593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.054775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.054850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.055115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.055224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.055435] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.055551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.055622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.055821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.055909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.056010] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a6023d-5c33-4db0-b5c2-37c37091322f is going to be updated. [ 723.090286] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.090551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.091356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.091356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.091356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.103312] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: IN_PROGRESS for 2s [ 723.420856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.420856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.420856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.420856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.420856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.420856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec315c8-eeab-41e7-9949-c122e613d204 already deleted. [ 723.420856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec315c8-eeab-41e7-9949-c122e613d204" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.063710] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 10s [ 725.117354] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4a6023d-5c33-4db0-b5c2-37c37091322f in Status: SUCCESS [ 725.117931] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4a6023d-5c33-4db0-b5c2-37c37091322f deletion is rescheduled due to dependency. [ 725.117931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4a6023d-5c33-4db0-b5c2-37c37091322f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.078159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 12s [ 727.886193] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 727.886323] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 729.091787] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 14s [ 729.346591] env[65455]: INFO networking_nsxv3.common.synchronization [None req-163e80af-2319-4a40-999e-6dc79e0f85d7 None None] Enqueued Resource ID: 21238e68-8959-42d0-b26f-c3213ae2fef6 with Priority: HIGHEST for action port [ 729.347867] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21238e68-8959-42d0-b26f-c3213ae2fef6 with Priority: HIGHEST for action port [ 729.347867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-21238e68-8959-42d0-b26f-c3213ae2fef6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.347867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21238e68-8959-42d0-b26f-c3213ae2fef6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.347867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21238e68-8959-42d0-b26f-c3213ae2fef6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.348149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21238e68-8959-42d0-b26f-c3213ae2fef6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.348149] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21238e68-8959-42d0-b26f-c3213ae2fef6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.653306] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0135a2eb-1b8d-430d-8462-7af6a586b790 None None] Enqueued Resource ID: 492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b with Priority: HIGHEST for action port [ 729.653306] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b with Priority: HIGHEST for action port [ 729.653306] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.653453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.653512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.653954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.654484] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.850912] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21238e68-8959-42d0-b26f-c3213ae2fef6 [ 729.851194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.851330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.851409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.851624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.851713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.851809] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21238e68-8959-42d0-b26f-c3213ae2fef6 already deleted. [ 729.851892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21238e68-8959-42d0-b26f-c3213ae2fef6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.158911] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b [ 730.159174] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.159352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.159352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.159497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.159586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.159680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b already deleted. [ 730.159760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-492d28eb-7f78-49f4-a0eb-7fb9f5f46c7b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.064000] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 731.064000] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 731.064000] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 731.064000] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 731.064297] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.068665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.068665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.068665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.068775] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.068829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.069072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.069139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.069177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.069287] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.070744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.070744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.070744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.070929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.071040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.072026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.072026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.072026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.072026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.072026] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.108936] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 16s [ 731.116141] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 731.116328] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 731.116470] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_rules [ 731.116602] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 731.117378] env[65455]: INFO networking_nsxv3.common.synchronization [req-30c4a461-9467-4e5d-a2ad-46b2961a933f req-0ab62ed7-4db4-4047-beb9-c00cc07e941c tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 731.121212] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 731.121212] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_rules [ 731.121212] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 731.121212] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 731.121212] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 731.121212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.121212] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.121212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.121212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.121212] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.123693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a685d5e-d0f1-464e-9aee-4bdd53823868 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.123693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.123693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.123693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.123693] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a685d5e-d0f1-464e-9aee-4bdd53823868',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.123693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.123693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.123947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.123947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.576392] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.577504] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.627449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.627449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.627449] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a685d5e-d0f1-464e-9aee-4bdd53823868 with status ACTIVE [ 731.627449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.627449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.627449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.627935] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.627935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.627935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.627935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.627935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.627935] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 is going to be updated. [ 731.657603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.657603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.657603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.657603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.657603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.657603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.908440] env[65455]: INFO networking_nsxv3.common.synchronization [None req-59fa8269-791d-4d82-9ca8-254e25aee532 tempest-ServersTestBootFromVolume-994483071 tempest-ServersTestBootFromVolume-994483071-project-member] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 731.909049] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 731.909346] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.909474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.909541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.909800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.909891] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.080258] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.081310] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.372575] env[65455]: INFO networking_nsxv3.common.synchronization [req-d32923fe-b109-4760-9dcd-0ad8f349326b req-3e7a91e1-e79c-43fa-9549-0c51ded28837 tempest-ImagesOneServerTestJSON-1293947550 tempest-ImagesOneServerTestJSON-1293947550-project-member] Enqueued Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 732.373187] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 732.374186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.376239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.376350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.376866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.377067] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.378313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.378313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.378313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.378313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.378313] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.434902] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.434902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.434902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.434902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.434902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.434902] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd already deleted. [ 732.434902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.442226] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5ae4dff0-a4b9-4b25-8e7e-80255d0e3fa8 tempest-ServersTestBootFromVolume-994483071 tempest-ServersTestBootFromVolume-994483071-project-member] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 732.442226] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 732.442707] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.442707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.442707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.442814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.442842] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.559058] env[65455]: INFO networking_nsxv3.common.synchronization [req-5f9c0098-73a6-43b3-9be1-dcffde2fce17 req-2b4e79c1-02ef-40b5-8e59-9b3f4a7491bf tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: 22c2b7fb-d386-4e5f-8287-fe3185f2b1b2 with Priority: HIGHEST for action security_group_rules [ 732.559058] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22c2b7fb-d386-4e5f-8287-fe3185f2b1b2 with Priority: HIGHEST for action security_group_rules [ 732.559058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22c2b7fb-d386-4e5f-8287-fe3185f2b1b2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.559058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22c2b7fb-d386-4e5f-8287-fe3185f2b1b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.559058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22c2b7fb-d386-4e5f-8287-fe3185f2b1b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.561833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22c2b7fb-d386-4e5f-8287-fe3185f2b1b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.561833] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22c2b7fb-d386-4e5f-8287-fe3185f2b1b2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.589169] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.589521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.589521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.590692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.590692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.590692] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 732.591480] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.591614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.591791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.594951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.594951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.594951] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be created. [ 732.619989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.621165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.621165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.621165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.621165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.625478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.625596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.625682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.625832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.626081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.636275] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 732.636875] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: UNINITIALIZED for 2s [ 732.801585] env[65455]: INFO networking_nsxv3.common.synchronization [None req-73bf73d5-5d75-4e49-adbe-ef7aa5e17d67 None None] Enqueued Resource ID: 84a6881e-388a-4969-9503-4b438aa3d763 with Priority: HIGHEST for action port [ 732.801585] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84a6881e-388a-4969-9503-4b438aa3d763 with Priority: HIGHEST for action port [ 732.801585] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-84a6881e-388a-4969-9503-4b438aa3d763 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.801585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84a6881e-388a-4969-9503-4b438aa3d763" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.801585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84a6881e-388a-4969-9503-4b438aa3d763" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.801945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84a6881e-388a-4969-9503-4b438aa3d763" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.801945] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84a6881e-388a-4969-9503-4b438aa3d763',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.885088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.885088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.885088] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a already deleted. [ 732.885088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.973037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.973037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.973208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.973415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.973585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.975265] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd already deleted. [ 732.975265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.082371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.082489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.082489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.082791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.082898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.083038] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22c2b7fb-d386-4e5f-8287-fe3185f2b1b2 already deleted. [ 733.083235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22c2b7fb-d386-4e5f-8287-fe3185f2b1b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.126161] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 18s [ 733.139571] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.141022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-613" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.141022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-613" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.141022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-613" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.141022] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.141022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.141494] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.142164] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.142509] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.143225] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.143504] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.143770] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.144121] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.144372] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.145280] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.145280] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.170198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.170378] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.170514] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.170689] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-613" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.171045] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-87fe316c-5824-495c-848e-e3fc2b39ec9c taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.171258] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.171378] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.171705] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.171832] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87fe316c-5824-495c-848e-e3fc2b39ec9c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.305243] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84a6881e-388a-4969-9503-4b438aa3d763 [ 733.305679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.305846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.305932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.306363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.306491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.306659] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84a6881e-388a-4969-9503-4b438aa3d763 already deleted. [ 733.306802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84a6881e-388a-4969-9503-4b438aa3d763" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.675985] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.676398] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.676398] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.678225] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.678461] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.678663] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 87fe316c-5824-495c-848e-e3fc2b39ec9c not found, creating... [ 733.679113] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.680168] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.680235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.681341] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.681655] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.681884] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.682130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.682581] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.682581] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.682659] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.682814] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 87fe316c-5824-495c-848e-e3fc2b39ec9c is going to be created. [ 733.710293] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.710892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.710892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.711032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.711239] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.711524] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.933868] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8847526e-8478-4009-87c0-619a472aa36c None None] Enqueued Resource ID: 0cc98f9e-55cc-4505-97ae-ea35f40d4ba0 with Priority: HIGHEST for action port [ 733.934534] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cc98f9e-55cc-4505-97ae-ea35f40d4ba0 with Priority: HIGHEST for action port [ 733.934861] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cc98f9e-55cc-4505-97ae-ea35f40d4ba0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.934988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cc98f9e-55cc-4505-97ae-ea35f40d4ba0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.935070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cc98f9e-55cc-4505-97ae-ea35f40d4ba0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.935599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cc98f9e-55cc-4505-97ae-ea35f40d4ba0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.935688] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cc98f9e-55cc-4505-97ae-ea35f40d4ba0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.058204] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 734.058370] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 734.058545] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 734.059055] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 734.059192] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 734.059293] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 734.060043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060439] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.060621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.060621] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.060743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.060796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.061027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.061027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.061216] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_rules [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_rules [ 734.117024] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 734.117876] env[65455]: INFO networking_nsxv3.common.synchronization [req-6b4dff44-9244-4cba-87dd-4f400e7943f9 req-0d2e11d8-4d23-429a-aa9d-b12ae37694cc tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 734.119076] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_rules [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 with Priority: HIGHEST for action port [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_rules [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 734.121021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 734.121021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.121021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.121436] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.121677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.121820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.122212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.122534] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.123901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124484] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a685d5e-d0f1-464e-9aee-4bdd53823868 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.125054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.125512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.128893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a685d5e-d0f1-464e-9aee-4bdd53823868',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.128893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.128893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.128893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.128893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.128893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.128893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.437570] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cc98f9e-55cc-4505-97ae-ea35f40d4ba0 [ 734.437805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.437945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.438026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.438254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.438349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.438446] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cc98f9e-55cc-4505-97ae-ea35f40d4ba0 already deleted. [ 734.438528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cc98f9e-55cc-4505-97ae-ea35f40d4ba0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.496800] env[65455]: INFO networking_nsxv3.common.synchronization [req-d32923fe-b109-4760-9dcd-0ad8f349326b req-349922ba-96e2-43e6-b10f-aeb3a2399424 service nova] Enqueued Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_rules [ 734.496925] env[65455]: INFO networking_nsxv3.common.synchronization [req-d32923fe-b109-4760-9dcd-0ad8f349326b req-349922ba-96e2-43e6-b10f-aeb3a2399424 service nova] Enqueued Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 734.497074] env[65455]: INFO networking_nsxv3.common.synchronization [req-d32923fe-b109-4760-9dcd-0ad8f349326b req-349922ba-96e2-43e6-b10f-aeb3a2399424 service nova] Enqueued Resource ID: 87fe316c-5824-495c-848e-e3fc2b39ec9c with Priority: HIGHEST for action port [ 734.497690] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_rules [ 734.498159] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 734.498159] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87fe316c-5824-495c-848e-e3fc2b39ec9c with Priority: HIGHEST for action port [ 734.498373] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.498469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.498537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.498802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.498892] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.499774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.499846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.499915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.500097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.500242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.500371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.500476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.500666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.501051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.501051] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.501740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-87fe316c-5824-495c-848e-e3fc2b39ec9c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.501858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.501921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.502096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.502172] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87fe316c-5824-495c-848e-e3fc2b39ec9c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.564526] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.628824] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a685d5e-d0f1-464e-9aee-4bdd53823868 with status ACTIVE [ 734.629087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.629220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.629289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.629505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.629632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.629762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.629856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.629915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.630109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.630215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.630368] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.630995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.631553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.631553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.631553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.631553] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a685d5e-d0f1-464e-9aee-4bdd53823868 is going to be updated. [ 734.632938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.633043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.653311] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 734.653311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.653311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.653619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.653697] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.654137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.654137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.654137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.654137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.654322] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.658687] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 734.658880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.659043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.659515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.659845] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.659949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.660116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.660745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.660745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.660745] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.667235] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.667235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.667337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.667717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.667717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.667814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a685d5e-d0f1-464e-9aee-4bdd53823868" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.805872] env[65455]: INFO networking_nsxv3.common.synchronization [req-817f65d4-eece-4887-8343-dc3ceebd22b4 req-36203b79-17b6-4b4f-b69b-1a4df7c66ecd tempest-FloatingIPsAssociationTestJSON-414106725 tempest-FloatingIPsAssociationTestJSON-414106725-project-member] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 734.807642] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGHEST for action security_group_members [ 734.808930] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.808930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.808930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.811234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.811435] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.811555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.811619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.811809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.811896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.811995] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.007076] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.007397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.007705] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.008690] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87fe316c-5824-495c-848e-e3fc2b39ec9c with status ACTIVE [ 735.008899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.009033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.009101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.009338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.009427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.009613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.009709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.009767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.009923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.009996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.010203] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.010331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.010422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.010625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.010721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.010834] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87fe316c-5824-495c-848e-e3fc2b39ec9c is going to be updated. [ 735.037832] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.037971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.038059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.038288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.038433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.038593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87fe316c-5824-495c-848e-e3fc2b39ec9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.052795] env[65455]: INFO networking_nsxv3.common.synchronization [req-924c04cd-6260-442c-a522-8bdde1858776 req-b039472e-6c2e-40e6-8162-8162b7756649 tempest-VolumesAssistedSnapshotsTest-1816646194 tempest-VolumesAssistedSnapshotsTest-1816646194-project-member] Enqueued Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 735.053369] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 with Priority: HIGHEST for action security_group_members [ 735.053654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-07680d19-56f1-4d34-ab9f-26b0ad63d370 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.053766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.053837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.054715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.054888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.055772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.055772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.055772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.055772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.055772] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07680d19-56f1-4d34-ab9f-26b0ad63d370',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.068224] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.142674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 20s [ 735.157594] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.162627] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.220590] env[65455]: INFO networking_nsxv3.common.synchronization [req-86ef82c1-75b4-4491-97e7-8dc1751f70e4 req-2bb17bf5-44cf-4540-96bf-309f3e178db2 tempest-ServerAddressesTestJSON-1320620343 tempest-ServerAddressesTestJSON-1320620343-project-member] Enqueued Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 735.221526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 735.221867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.221987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.222614] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.222722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.222785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.222950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.223048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.223143] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.314335] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.314500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.314573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.314792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.314899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.315228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.315354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.315422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.315607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.315702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.315793] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be updated. [ 735.349293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.349509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.349614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.349843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.350019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.362294] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: IN_PROGRESS for 2s [ 735.515246] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.558753] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.558935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.558976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.559217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.571599] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.572490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.572490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.572490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.572490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.572490] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be created. [ 735.590426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.590709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.590823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.590893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.591110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.591197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.591285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 is going to be updated. [ 735.603594] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.603594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.603594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.603594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.603759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.619100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: UNINITIALIZED for 2s [ 735.633431] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.633614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.633680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.634041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.634108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.644751] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: IN_PROGRESS for 2s [ 735.663129] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.670665] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.709084] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-675 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.709282] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-675" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.709282] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-675" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.709575] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-675" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.710052] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.710553] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.710553] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.711802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.711802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.711802] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.711802] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.711802] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.711802] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.711802] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.711802] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.711802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.726522] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.726863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.726948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.727204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.727298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.727511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.727616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.727679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.727835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.727910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.727997] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af already deleted. [ 735.728094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.742518] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.742760] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.742877] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.743069] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-675" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.743446] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-40654650-a8b6-4d66-952c-822fc2c25da7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.743632] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.743754] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.744514] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.744758] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40654650-a8b6-4d66-952c-822fc2c25da7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.021172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.021172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.021172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.021172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.021172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.021172] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a is going to be created. [ 736.048354] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.048354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.048354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.048354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.048354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.057535] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: UNINITIALIZED for 2s [ 736.174530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.174690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.174762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.174987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.175172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.175305] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 736.176653] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.176772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.176840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.177030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.177141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.177311] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 736.208305] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.208536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.208619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.208827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.208970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.211026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.211132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.211207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.211421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.211566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.223240] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 736.223914] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 736.248295] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.248518] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.248633] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.248908] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.249054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.249203] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 40654650-a8b6-4d66-952c-822fc2c25da7 not found, creating... [ 736.249506] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.249664] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.249774] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.249991] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.250136] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.250408] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.250556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.250668] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.250872] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.251122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.251283] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 40654650-a8b6-4d66-952c-822fc2c25da7 is going to be created. [ 736.301328] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.301683] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.302025] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.302136] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.302402] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.302744] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.080352] env[65455]: INFO networking_nsxv3.common.synchronization [req-86ef82c1-75b4-4491-97e7-8dc1751f70e4 req-b71ae444-c0d7-4ede-b5bf-1a3672161038 service nova] Enqueued Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_rules [ 737.080352] env[65455]: INFO networking_nsxv3.common.synchronization [req-86ef82c1-75b4-4491-97e7-8dc1751f70e4 req-b71ae444-c0d7-4ede-b5bf-1a3672161038 service nova] Enqueued Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 737.080352] env[65455]: INFO networking_nsxv3.common.synchronization [req-86ef82c1-75b4-4491-97e7-8dc1751f70e4 req-b71ae444-c0d7-4ede-b5bf-1a3672161038 service nova] Enqueued Resource ID: 40654650-a8b6-4d66-952c-822fc2c25da7 with Priority: HIGHEST for action port [ 737.082448] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_rules [ 737.082448] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 737.082689] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40654650-a8b6-4d66-952c-822fc2c25da7 with Priority: HIGHEST for action port [ 737.082867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.082992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.083080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.083350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.083651] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.084702] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.085652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.085652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.088340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.088340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.088340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.088340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.088340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.088340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.088340] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.088620] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-40654650-a8b6-4d66-952c-822fc2c25da7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.088620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.088620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.089226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.089226] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40654650-a8b6-4d66-952c-822fc2c25da7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.158663] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 22s [ 737.376948] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 in Status: SUCCESS [ 737.376948] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 deletion is rescheduled due to dependency. [ 737.376948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.593981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.593981] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40654650-a8b6-4d66-952c-822fc2c25da7 with status ACTIVE [ 737.593981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.593981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.593981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.594562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.595200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.595492] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.595742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.595877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.596256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.599721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.599721] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40654650-a8b6-4d66-952c-822fc2c25da7 is going to be updated. [ 737.599721] env[65455]: INFO networking_nsxv3.common.synchronization [None req-fc2a1a93-e358-40e5-889f-24f8458a904f None None] Enqueued Resource ID: 19acca26-cc70-4ab1-9311-33f545aed987 with Priority: HIGHEST for action port [ 737.599721] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.600602] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19acca26-cc70-4ab1-9311-33f545aed987 with Priority: HIGHEST for action port [ 737.601791] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-19acca26-cc70-4ab1-9311-33f545aed987 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.602034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19acca26-cc70-4ab1-9311-33f545aed987" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.602119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19acca26-cc70-4ab1-9311-33f545aed987" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.602406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19acca26-cc70-4ab1-9311-33f545aed987" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.602526] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19acca26-cc70-4ab1-9311-33f545aed987',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.629652] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: SUCCESS [ 737.629862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.630047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.630284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.630530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.630664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.630730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.630908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.630993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.631106] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.636030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.636241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.640084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.640084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.640084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.640084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40654650-a8b6-4d66-952c-822fc2c25da7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.659128] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 in Status: SUCCESS [ 737.659128] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07680d19-56f1-4d34-ab9f-26b0ad63d370 deletion is rescheduled due to dependency. [ 737.659128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07680d19-56f1-4d34-ab9f-26b0ad63d370" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.697507] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-4b94a7ba-6b5b-46a8-92e2-7100f2ef5a15 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 737.700018] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 737.700018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.700018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.700018] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.076632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: SUCCESS [ 738.076855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.077045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.077301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.077500] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.077619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.077685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.077838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.077916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.077997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.078101] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.098685] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-6b7b1a90-031c-4d68-96f6-aa7b16f3aa56 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 738.099527] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 738.101086] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.101086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.102255] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.107033] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19acca26-cc70-4ab1-9311-33f545aed987 [ 738.107033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.107033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.107033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.107033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.107033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.107033] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19acca26-cc70-4ab1-9311-33f545aed987 already deleted. [ 738.107033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19acca26-cc70-4ab1-9311-33f545aed987" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.134315] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.204574] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.204849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.204952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.205241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.205350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.205589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.205713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.205781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.206009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.206137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.206241] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 738.239087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.239270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.239325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.239524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.239653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.241919] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 738.242167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.242353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.242588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.242812] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.242934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.242995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.243182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.243266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.243350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.243470] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.245698] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 738.245698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.245698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.245698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.245963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.245963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.245963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.246256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.246256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.246256] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.247088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.247311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.247481] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.247589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.247674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.247861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.247918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.247971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.248062] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.249600] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 738.250196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.250260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.250395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.250498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.250559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.250783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.250885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.250969] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.584342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.584500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.584576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.584794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.584961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.585499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.585499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.585499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.585499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.585729] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.585729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.585805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.585896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.586051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.586232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.586307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.586452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.586532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.586835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.586835] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.607583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.610261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.610261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.610261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.610261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.610261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af is going to be created. [ 738.625020] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.625020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-457" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-457" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-457" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.628065] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.628065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.628065] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.628065] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.628065] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.628065] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.628065] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.632068] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.632068] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.639716] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.643540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.645388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.645647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.645987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.646311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.660567] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: UNINITIALIZED for 2s [ 738.661845] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.662012] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.662158] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.662333] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-457" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.662641] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-54d8c2ec-8142-4878-878a-e83a1d3bbceb taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.662806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.662919] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.665307] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.665465] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54d8c2ec-8142-4878-878a-e83a1d3bbceb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.753193] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.753193] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.753193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.753193] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.753193] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.089908] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a: rpc.has_security_group_logging(os_id): False [ 739.116741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.117828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.118034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.118395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.118557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.119009] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.119150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.119220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.119413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.119502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.119734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.119812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.119877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.120240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.120349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.120549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.120649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.120713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.120866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.120944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.121042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a is going to be created. [ 739.143302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.143944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.144284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.144668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.144837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.147021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be updated. [ 739.168134] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.168134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.168286] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.169018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.169018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.169018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 54d8c2ec-8142-4878-878a-e83a1d3bbceb not found, creating... [ 739.169432] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.169600] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.169731] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.169987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.170139] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.170452] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.170612] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.170723] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.170955] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.174544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.174873] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 54d8c2ec-8142-4878-878a-e83a1d3bbceb is going to be created. [ 739.178822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 24s [ 739.192321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.192605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.192728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.193041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.193311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.207957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: IN_PROGRESS for 2s [ 739.210259] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e73b575-df27-431f-901d-58cdefe78433 req-5036d406-b017-4feb-b897-ea83476770c4 tempest-ServerTagsTestJSON-139058559 tempest-ServerTagsTestJSON-139058559-project-member] Enqueued Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 739.210832] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGHEST for action security_group_members [ 739.211189] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.211401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.211401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.212305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.212653] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.212808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.212903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.213123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.213250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.213378] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.215856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.216075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.216276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.216522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.216775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.219528] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.219804] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.219982] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.220312] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.220607] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.220951] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.237942] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: IN_PROGRESS for 2s [ 739.258790] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.258790] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.258790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fadf75a5-9161-4bdb-8e45-26618ca6c5ea: rpc.has_security_group_logging(os_id): False [ 739.301023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.301246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.302055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.302055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.302055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.302055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.302055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.302055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.302333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.302333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.302455] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be created. [ 739.440859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.440859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.440859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.440859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.440859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.461117] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 739.725651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.725821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.725884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.726174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.753074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.754126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.754126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.754126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.754126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.754630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.754630] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 is going to be updated. [ 739.763198] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.763198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.763198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.763198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.763198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.763198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 739.764185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.764344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.764443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.764709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.764806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.764933] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 739.802625] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.802625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.802625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.802625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.802930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.805658] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.805658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.805658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.805855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.805855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.809022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.809022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.809022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.809022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.809022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.820755] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 739.820755] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 739.821405] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: IN_PROGRESS for 2s [ 740.074714] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-48e3f371-6ce0-49bc-b900-dfad836023eb service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 740.074714] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-48e3f371-6ce0-49bc-b900-dfad836023eb service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 740.074714] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-48e3f371-6ce0-49bc-b900-dfad836023eb service nova] Enqueued Resource ID: 54d8c2ec-8142-4878-878a-e83a1d3bbceb with Priority: HIGHEST for action port [ 740.075877] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 740.076351] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 740.076662] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54d8c2ec-8142-4878-878a-e83a1d3bbceb with Priority: HIGHEST for action port [ 740.080799] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.081554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.084139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.084139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.084139] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.084139] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.084139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.084139] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-54d8c2ec-8142-4878-878a-e83a1d3bbceb taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.084589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.084753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.085047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.085235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54d8c2ec-8142-4878-878a-e83a1d3bbceb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.100028] env[65455]: INFO networking_nsxv3.common.synchronization [None req-33356370-d3d7-429f-a92a-a886559f120e None None] Enqueued Resource ID: 028d7b26-8bab-4738-b127-c1aec4b6cfd0 with Priority: HIGHEST for action port [ 740.100767] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 028d7b26-8bab-4738-b127-c1aec4b6cfd0 with Priority: HIGHEST for action port [ 740.101709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-028d7b26-8bab-4738-b127-c1aec4b6cfd0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.101974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-028d7b26-8bab-4738-b127-c1aec4b6cfd0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.102172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-028d7b26-8bab-4738-b127-c1aec4b6cfd0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.102524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-028d7b26-8bab-4738-b127-c1aec4b6cfd0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.102694] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028d7b26-8bab-4738-b127-c1aec4b6cfd0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.268336] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 740.268336] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c deletion is rescheduled due to dependency. [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.268336] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.268336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.269180] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.587651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.587651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.587811] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54d8c2ec-8142-4878-878a-e83a1d3bbceb with status ACTIVE [ 740.587921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.588039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.588105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.588489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.588489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.588701] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.588701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.588833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.589066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.589066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.589359] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.589467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.589536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.589705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.589786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.589867] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54d8c2ec-8142-4878-878a-e83a1d3bbceb is going to be updated. [ 740.604496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 028d7b26-8bab-4738-b127-c1aec4b6cfd0 [ 740.604724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.605076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.605076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.605299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.605411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.605510] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:028d7b26-8bab-4738-b127-c1aec4b6cfd0 already deleted. [ 740.605595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-028d7b26-8bab-4738-b127-c1aec4b6cfd0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.617694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.617842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.617905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.619442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.619442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.619442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54d8c2ec-8142-4878-878a-e83a1d3bbceb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.676916] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: SUCCESS [ 740.677164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.678297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.678392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.678764] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.679050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.679093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.679257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679451] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.773810] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.981761] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.981967] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-787" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.982103] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-787" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.982444] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-787" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.982743] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.982901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.983025] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.983248] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.983388] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.983590] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.983697] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.983804] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.983904] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.984012] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.984119] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.984248] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 741.003962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 741.004754] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 741.004991] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 741.005220] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-787" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.005557] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.006038] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.006290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.006734] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.006982] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a3e007-f190-49a5-ac63-e5a26c2dee7d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.183532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.183532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.183532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.184378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.186016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.188251] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.188251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.188251] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.188998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.188998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.188998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.188998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.188998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.188998] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.195660] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 26s [ 741.217166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: SUCCESS [ 741.217469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.217633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.217799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.218027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.218273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.218273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.218416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.218590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.218590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.218681] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.253983] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: SUCCESS [ 741.254300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.277534] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.475671] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 741.476392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.476392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.476392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.476686] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.510349] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.510671] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.510749] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.510984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.511147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.511358] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port b2a3e007-f190-49a5-ac63-e5a26c2dee7d not found, creating... [ 741.511802] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.511992] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.512187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.512467] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.512635] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.512933] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.513122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.513261] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.513503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.513678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.513832] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: b2a3e007-f190-49a5-ac63-e5a26c2dee7d is going to be created. [ 741.538776] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.539014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.539147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.539486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.539724] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.539977] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.692471] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af: rpc.has_security_group_logging(os_id): False [ 741.717381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.717381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.717381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.717381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.717381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.717651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.717651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.717651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.717813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.717880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.718088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.718187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.718250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.718395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.718525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.718651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.718738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.718797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.718938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.719207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.719370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af is going to be created. [ 741.720628] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.780400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.781626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.781626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.781626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.781626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.781626] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 741.797600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.797813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.799382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.799382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.799382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.821678] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: IN_PROGRESS for 2s [ 741.833190] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 741.835220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.835469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.835736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.835929] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.836068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.836201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.836484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.836484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.836657] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.837985] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 741.838220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.839840] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.839958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.839997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.840193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.840331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.842997] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 in Status: SUCCESS [ 741.843173] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 deletion is rescheduled due to dependency. [ 741.843288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.843618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.844013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.844071] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.844187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.844255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.844415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.844731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.844731] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.859280] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 741.978513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.978670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.223944] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea5c289d-af02-4d2b-a1c6-0622c1d1d251: rpc.has_security_group_logging(os_id): False [ 742.261540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.261667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.261712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.262982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.262982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.262982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be created. [ 742.347156] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.352196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.352196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.352196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.352196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.352196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.352507] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.372560] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: IN_PROGRESS for 2s [ 742.383730] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-956e7d96-59b6-4881-b2bb-dd85d04fe7ac service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 742.385019] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-956e7d96-59b6-4881-b2bb-dd85d04fe7ac service nova] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 742.385019] env[65455]: INFO networking_nsxv3.common.synchronization [req-70d22132-3852-424d-9a3e-384e7a8a702e req-956e7d96-59b6-4881-b2bb-dd85d04fe7ac service nova] Enqueued Resource ID: b2a3e007-f190-49a5-ac63-e5a26c2dee7d with Priority: HIGHEST for action port [ 742.385019] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_rules [ 742.385280] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 742.385826] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2a3e007-f190-49a5-ac63-e5a26c2dee7d with Priority: HIGHEST for action port [ 742.386374] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.386559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.386866] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.386962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.387556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.389515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.389584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.389836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.389917] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2a3e007-f190-49a5-ac63-e5a26c2dee7d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.856018] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.857407] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.892279] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2a3e007-f190-49a5-ac63-e5a26c2dee7d with status ACTIVE [ 742.892423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.896206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.896341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.896665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.896752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.897073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.897201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.897298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.897468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.897554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.897813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.897926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.898148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.898222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.898270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.898370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2a3e007-f190-49a5-ac63-e5a26c2dee7d is going to be updated. [ 742.923713] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.923869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.923938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.924314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.924460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.924631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2a3e007-f190-49a5-ac63-e5a26c2dee7d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.211370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 28s [ 743.359674] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.360032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.360032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.360291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.360291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.360377] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 743.361689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.361786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.361831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.362016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.362110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.362198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 743.397263] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.397497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.397615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.397854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.397991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.399970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.400128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.400204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.400383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.400573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.416959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 743.417838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 743.835986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: SUCCESS [ 743.835986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.874137] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 743.874137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.874137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.874137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.874137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.874137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.874137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.874692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.874692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.874692] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.179036] env[65455]: INFO networking_nsxv3.common.synchronization [req-60feac5a-0a00-4b14-8c8f-41891984dd7f req-3af80473-2e36-48d4-844c-95aa0ae6f662 tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 744.184152] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 744.184584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9589e837-287a-4223-976f-04f4f7ed96d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.184773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.184842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.185240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.185340] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9589e837-287a-4223-976f-04f4f7ed96d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.378194] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.390328] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: SUCCESS [ 744.390605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.557065] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f2b2d27-af70-4072-a585-45214632bd7b req-6d43c2d6-367a-41b4-bdbc-8e1cb20c9349 tempest-ListImageFiltersTestJSON-37393499 tempest-ListImageFiltersTestJSON-37393499-project-member] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 744.557860] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 744.558844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.558844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.558844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.559489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.559489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.559489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.559489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.559489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.559760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.559760] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.712405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.712599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.712693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.713094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.713217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.713329] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9589e837-287a-4223-976f-04f4f7ed96d8 already deleted. [ 744.713437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.880502] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.948602] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.948903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.949060] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.949334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.949599] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.950506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.950506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.950506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.950506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.950883] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.950883] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.950883] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.950883] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.951043] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.951264] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.951316] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.977863] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.978118] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.978207] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.978382] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.978803] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.979199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.979199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.979439] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.979619] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.063600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.063600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.063600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.064078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.064751] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 already deleted. [ 745.064751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.233682] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 30s [ 745.386627] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.387183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.387183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.387183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.387183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.387446] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 745.424875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.425084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.425084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.425315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.425475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.434273] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 745.434613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.434709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.435042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.435249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.435376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.435446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.435612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.435697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.435787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.435904] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.437674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 745.437884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.438701] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 745.438906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.439058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.439286] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.439365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.439408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.439552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.439644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.439734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.439897] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.439996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.440074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.440239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.440388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.440482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.440537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.440790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.440790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.440978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.441110] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.483342] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.483772] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.483941] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.484341] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.484500] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.484655] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 not found, creating... [ 745.484941] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.485109] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.485222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.485453] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.485585] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.485869] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.486037] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.486176] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.486409] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.486541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.486677] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 is going to be created. [ 745.524661] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.524863] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.524981] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.525279] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.525504] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.525729] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.943878] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 745.945171] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.972604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.973837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.973922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.974193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.974308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.974522] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.974629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.974692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.974857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.974934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.975144] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.975239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.975299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.975440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.975514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.975711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.975804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.975863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.978089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.978249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.978354] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 746.051311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.051470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.051601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.051861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.052055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.072620] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 746.298935] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f2b2d27-af70-4072-a585-45214632bd7b req-2cb34f97-4d5b-4fad-a89e-a8adf5047262 service nova] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_rules [ 746.299132] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f2b2d27-af70-4072-a585-45214632bd7b req-2cb34f97-4d5b-4fad-a89e-a8adf5047262 service nova] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 746.302980] env[65455]: INFO networking_nsxv3.common.synchronization [req-8f2b2d27-af70-4072-a585-45214632bd7b req-2cb34f97-4d5b-4fad-a89e-a8adf5047262 service nova] Enqueued Resource ID: 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 with Priority: HIGHEST for action port [ 746.302980] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_rules [ 746.302980] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 746.302980] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 with Priority: HIGHEST for action port [ 746.302980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.302980] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.302980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.302980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.302980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.302980] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.303819] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.303903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.303967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.304227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.306039] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.392895] env[65455]: INFO networking_nsxv3.common.synchronization [req-a7add6f3-e65c-4557-8a1a-2e13ee2cd51b req-ab12a0f8-af8f-4be2-9b4f-ce2c73de5c3a tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 746.393269] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 746.393614] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9589e837-287a-4223-976f-04f4f7ed96d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.393703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.393703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.394404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.394404] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9589e837-287a-4223-976f-04f4f7ed96d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.448785] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fadf75a5-9161-4bdb-8e45-26618ca6c5ea: rpc.has_security_group_logging(os_id): False [ 746.469861] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.469861] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.469861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.469861] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 746.529611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.529750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.529833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.530461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.530461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.547447] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 746.806475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.806641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.807028] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.808085] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 with status ACTIVE [ 746.808532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.808532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.808532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.808702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.808776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.808952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.809075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.809152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.809340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.809403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.809549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.809641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.809702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.809844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.809919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.810014] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5 is going to be updated. [ 746.836640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.836839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.836884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.837337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.837534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.838985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22c0e9bb-9dd6-452a-90e3-8d1c5b12fac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.928672] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.928864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.928945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.929163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.929257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.929353] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9589e837-287a-4223-976f-04f4f7ed96d8 already deleted. [ 746.929444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.257856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 32s [ 747.312735] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.450281] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 747.451027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.451130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.451389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.451654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.451839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.452106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.452359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.452466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.452600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.452725] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.453967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.454415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.454647] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.454800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.454895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.455098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.455441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.455567] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.660327] env[65455]: INFO networking_nsxv3.common.synchronization [req-c6e0c4bd-2189-4a95-b38c-dad26f10ac3f req-9f13836d-5aa8-47d0-99d0-0d36a32e8d05 tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 747.660820] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 747.661294] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.661489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.661530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.661736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.661908] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.662026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.662090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.662676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.662676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.662676] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.816334] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.816637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.816772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.817249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.817407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.817524] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be created. [ 747.852729] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.852878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.852944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.853348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.853394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.865280] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: UNINITIALIZED for 2s [ 747.958564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.958780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.959330] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.089186] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 748.089596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.089739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.090040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.090140] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.164543] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.165273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.165273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.165273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.165474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.165834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.166028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.166106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.166426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.166481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.166592] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 748.184286] env[65455]: INFO networking_nsxv3.common.synchronization [req-02bb5cc1-cadb-4308-95a1-b6554f3af3c4 req-ab5aeb1e-e53d-466b-9b64-4bc1b57c2b93 tempest-ListImageFiltersTestJSON-37393499 tempest-ListImageFiltersTestJSON-37393499-project-member] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 748.184286] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 748.184286] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.184286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.203318] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.203709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.203902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.204254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.208194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.217438] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 748.462197] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.565060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 748.565419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.592587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.592767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.592849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.593331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.593662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.593829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.594076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.594172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.594258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.594550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.594550] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.729261] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.729351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.729481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.729773] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.730142] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.730383] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.730562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.730874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.731559] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.731559] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.731559] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.731736] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.731769] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.732075] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.732865] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.735530] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.757629] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.757800] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.757891] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.758175] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.758552] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-6dd39590-4f8e-4d98-925e-25e87fad5ccc taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.758811] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.759059] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.759451] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.759802] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd39590-4f8e-4d98-925e-25e87fad5ccc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.966645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.966645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.966645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.966645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.966645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.966645] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 749.000581] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.000581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.000581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.000581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.000581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.013445] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 749.098121] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.100934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.100934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.100934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.100934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.101571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.101571] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.264140] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.264919] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.264919] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.265299] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.265614] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.265943] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 6dd39590-4f8e-4d98-925e-25e87fad5ccc not found, creating... [ 749.266606] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.266733] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.266876] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.267327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.268014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.268014] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.268264] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.268393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.268767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.269229] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.269229] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 6dd39590-4f8e-4d98-925e-25e87fad5ccc is going to be created. [ 749.294436] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 34s [ 749.301512] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.301737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.301860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.302332] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.302421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.303290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.604655] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 749.625356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.625553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.625693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.625981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.626169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.626778] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.626903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.627506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.627506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.627506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.627506] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.627506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.627774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.627806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.627877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.628347] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.628472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.628541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.628854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.628960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.629132] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 749.705545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.705702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.705791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.706044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.706293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.721722] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 749.877243] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 749.877622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.877893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.878383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.878577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.878778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.878901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.879202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.879536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.879536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.879674] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.880847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.881126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.881415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.881611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.881674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.882017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.882098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.882178] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.940910] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7e8fd6db-7fcd-46be-a310-5eda8147bc31 None None] Enqueued Resource ID: 08152940-b12e-407f-9b72-ff1d666cf8f8 with Priority: HIGHEST for action port [ 749.941640] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08152940-b12e-407f-9b72-ff1d666cf8f8 with Priority: HIGHEST for action port [ 749.941782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-08152940-b12e-407f-9b72-ff1d666cf8f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.941911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08152940-b12e-407f-9b72-ff1d666cf8f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.941979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08152940-b12e-407f-9b72-ff1d666cf8f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.942262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08152940-b12e-407f-9b72-ff1d666cf8f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.942346] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08152940-b12e-407f-9b72-ff1d666cf8f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.029847] env[65455]: INFO networking_nsxv3.common.synchronization [req-02bb5cc1-cadb-4308-95a1-b6554f3af3c4 req-37246a0f-e8df-420e-9b67-b2d37fb992f9 service nova] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_rules [ 750.030183] env[65455]: INFO networking_nsxv3.common.synchronization [req-02bb5cc1-cadb-4308-95a1-b6554f3af3c4 req-37246a0f-e8df-420e-9b67-b2d37fb992f9 service nova] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 750.030448] env[65455]: INFO networking_nsxv3.common.synchronization [req-02bb5cc1-cadb-4308-95a1-b6554f3af3c4 req-37246a0f-e8df-420e-9b67-b2d37fb992f9 service nova] Enqueued Resource ID: 6dd39590-4f8e-4d98-925e-25e87fad5ccc with Priority: HIGHEST for action port [ 750.031353] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_rules [ 750.031564] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 750.031823] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd39590-4f8e-4d98-925e-25e87fad5ccc with Priority: HIGHEST for action port [ 750.032820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.032820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.032820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.032820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.033052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dd39590-4f8e-4d98-925e-25e87fad5ccc taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.033264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.033375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.033656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.033769] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dd39590-4f8e-4d98-925e-25e87fad5ccc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.230995] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 750.231297] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 deletion is rescheduled due to dependency. [ 750.231370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.389848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.390021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.390205] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.446039] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08152940-b12e-407f-9b72-ff1d666cf8f8 [ 750.446039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.446743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.446743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.447189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.447189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.447267] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08152940-b12e-407f-9b72-ff1d666cf8f8 already deleted. [ 750.447385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08152940-b12e-407f-9b72-ff1d666cf8f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.541178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6dd39590-4f8e-4d98-925e-25e87fad5ccc with status ACTIVE [ 750.541178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.541178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.541178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.541960] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.542065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.542101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.542313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.542392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.542483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6dd39590-4f8e-4d98-925e-25e87fad5ccc is going to be updated. [ 750.575776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.576341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.576341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.578607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.578770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.578952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dd39590-4f8e-4d98-925e-25e87fad5ccc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.895535] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.025269] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 751.025683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.025890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.026190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.026433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.026570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.026641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.027670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.027670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.027969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.027969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.027969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.028625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.028625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.028625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.028771] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.117365] env[65455]: INFO networking_nsxv3.common.synchronization [req-5d6dec5f-d9a9-4b96-a6cd-45aa311f8e33 req-30d55a96-2990-4985-8bcc-e23cdd22af01 tempest-SecurityGroupRulesTestJSON-1291248060 tempest-SecurityGroupRulesTestJSON-1291248060-project-member] Enqueued Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 751.119987] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9589e837-287a-4223-976f-04f4f7ed96d8 with Priority: HIGHEST for action security_group_rules [ 751.119987] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9589e837-287a-4223-976f-04f4f7ed96d8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.119987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.119987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.120500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.120881] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9589e837-287a-4223-976f-04f4f7ed96d8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.309157] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 36s [ 751.400809] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.401389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.401686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.401896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.402086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.402296] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be updated. [ 751.437848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.437997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.438090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.438307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.438464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.451687] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 751.531877] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2645787-f0c6-445b-afb0-d7c9acc45e6c: rpc.has_security_group_logging(os_id): False [ 751.553150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.553502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.553684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.553970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.554175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.555303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.555303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.555303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.555303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.555303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.556397] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.556397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.556397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.556662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.556826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.557859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.557859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.557859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.557859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.557859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.557859] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 751.644161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.644161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.644161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.644460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.644460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.652849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.652980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.654430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.654430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.654430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.654430] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9589e837-287a-4223-976f-04f4f7ed96d8 already deleted. [ 751.654430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9589e837-287a-4223-976f-04f4f7ed96d8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.664823] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 751.748157] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 751.748157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.485784] env[65455]: INFO networking_nsxv3.common.synchronization [req-c9ae877d-681c-4439-90d4-62cfa6016975 req-28dcf52e-c320-4464-ac92-f2b53d77e0a5 tempest-ServerMetadataNegativeTestJSON-2103020927 tempest-ServerMetadataNegativeTestJSON-2103020927-project-member] Enqueued Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 752.487887] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 with Priority: HIGHEST for action security_group_members [ 752.488323] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8950d72-cdfa-4b89-babf-49c50bce2b96 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.488436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.488514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.488765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.490240] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.490240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.490240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.490240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.490240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.490240] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8950d72-cdfa-4b89-babf-49c50bce2b96',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.743269] env[65455]: INFO networking_nsxv3.common.synchronization [None req-c1a67544-b406-409d-b89e-ea1021877b2e None None] Enqueued Resource ID: 385dd5a2-4a1a-4a56-923e-5983ed1fe946 with Priority: HIGHEST for action port [ 752.743940] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 385dd5a2-4a1a-4a56-923e-5983ed1fe946 with Priority: HIGHEST for action port [ 752.745293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-385dd5a2-4a1a-4a56-923e-5983ed1fe946 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.745600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-385dd5a2-4a1a-4a56-923e-5983ed1fe946" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.745858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-385dd5a2-4a1a-4a56-923e-5983ed1fe946" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.745976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-385dd5a2-4a1a-4a56-923e-5983ed1fe946" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.746135] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('385dd5a2-4a1a-4a56-923e-5983ed1fe946',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.997636] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.997819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.997879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.998088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.998176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.998405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.998686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.998752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.998925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.999010] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.999185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 is going to be updated. [ 753.053607] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.053607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.053607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.053607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.053607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.065368] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: IN_PROGRESS for 2s [ 753.248727] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 385dd5a2-4a1a-4a56-923e-5983ed1fe946 [ 753.249156] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.249390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.249527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.249827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.249998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.250520] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:385dd5a2-4a1a-4a56-923e-5983ed1fe946 already deleted. [ 753.250691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-385dd5a2-4a1a-4a56-923e-5983ed1fe946" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.325192] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 38s [ 753.463212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 753.463437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.463655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.463830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.464025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.464155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.464224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.464387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.464470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.464563] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.682226] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 753.682506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.682626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.682886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.682973] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.969109] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.185505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.185505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.185505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.185948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.186275] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.186461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.186570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.186787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.186960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.187114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.187283] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.474042] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.690394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.690741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.690741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.690820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.690952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.691064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.691295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.691450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.691486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.691602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.691817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.691916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.691979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.692143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.692285] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.692378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.692949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.692949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.692949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.692949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.692949] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.978946] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.978946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.978946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.978946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.978946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.978946] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be updated. [ 755.009563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.009563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.009563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.009563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.009563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.022834] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 755.080932] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 in Status: SUCCESS [ 755.080932] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8950d72-cdfa-4b89-babf-49c50bce2b96 deletion is rescheduled due to dependency. [ 755.080932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8950d72-cdfa-4b89-babf-49c50bce2b96" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.195729] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2645787-f0c6-445b-afb0-d7c9acc45e6c: rpc.has_security_group_logging(os_id): False [ 755.245036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.245036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.245036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.245036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.246369] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.246369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.246369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.247297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.247297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.247474] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 755.346440] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 40s [ 755.361481] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.361481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.361481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.361481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.361481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.411634] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 756.086268] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e3f10191-0898-4e6d-b0d8-c8b963359471 None None] Enqueued Resource ID: ecb615e9-b93d-4945-b52c-a5723ae5a17f with Priority: HIGHEST for action port [ 756.090868] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecb615e9-b93d-4945-b52c-a5723ae5a17f with Priority: HIGHEST for action port [ 756.091252] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecb615e9-b93d-4945-b52c-a5723ae5a17f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.091384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecb615e9-b93d-4945-b52c-a5723ae5a17f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.091452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecb615e9-b93d-4945-b52c-a5723ae5a17f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.091722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecb615e9-b93d-4945-b52c-a5723ae5a17f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.093188] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecb615e9-b93d-4945-b52c-a5723ae5a17f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.597038] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecb615e9-b93d-4945-b52c-a5723ae5a17f [ 756.597038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.597038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.597038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.597038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.597038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.597038] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecb615e9-b93d-4945-b52c-a5723ae5a17f already deleted. [ 756.597038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecb615e9-b93d-4945-b52c-a5723ae5a17f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.035847] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.039023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.039023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.039023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.039868] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.362136] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 42s [ 757.429832] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 757.430202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.542375] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96905b57-3285-43c8-99f7-2f66d28aafa1: rpc.has_security_group_logging(os_id): False [ 757.562590] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.563070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.563070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.563975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.563975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.563975] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.563975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.563975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.564434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.564629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.564897] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.567505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.567505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.567505] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be created. [ 757.632310] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.632462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.632535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.632753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.632937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.651078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 758.784778] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a0144a9a-373a-4f1f-adb1-023cd9cdba08 None None] Enqueued Resource ID: 919d7b88-f29a-4c4a-a042-7c42ca5c257a with Priority: HIGHEST for action port [ 758.785433] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 919d7b88-f29a-4c4a-a042-7c42ca5c257a with Priority: HIGHEST for action port [ 758.785792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-919d7b88-f29a-4c4a-a042-7c42ca5c257a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.785954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-919d7b88-f29a-4c4a-a042-7c42ca5c257a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.786067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-919d7b88-f29a-4c4a-a042-7c42ca5c257a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.786489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-919d7b88-f29a-4c4a-a042-7c42ca5c257a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.786580] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('919d7b88-f29a-4c4a-a042-7c42ca5c257a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.292078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 919d7b88-f29a-4c4a-a042-7c42ca5c257a [ 759.292680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.292900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.292900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.295019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.295019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.295019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:919d7b88-f29a-4c4a-a042-7c42ca5c257a already deleted. [ 759.295019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-919d7b88-f29a-4c4a-a042-7c42ca5c257a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.376427] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 44s [ 759.664531] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 759.664763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.664949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.665222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.665335] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.169124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.169124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.169124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.169769] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.194791] env[65455]: INFO networking_nsxv3.common.synchronization [req-f0175b5a-9e6c-4a95-b954-89c01d6763ce req-aaa04e71-5c8d-4561-aae1-173c40dfb59a tempest-ServerAddressesTestJSON-1320620343 tempest-ServerAddressesTestJSON-1320620343-project-member] Enqueued Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 760.195396] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGHEST for action security_group_members [ 760.195727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.195848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.195908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.196952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.196952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.196952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.196952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.196952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.196952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.197377] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.671998] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.673199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.673345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.673713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.674030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.674209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.674288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.674476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.674676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.674676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.674816] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.674911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.674995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.675148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.675270] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.675353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.675406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.675548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.675621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.675701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.675791] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.699579] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.699743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.699821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.700048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.700142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.700670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.700670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.700670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.700670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.700870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.700870] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af is going to be updated. [ 760.733948] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.734184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.734184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.734407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.734556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.744620] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: IN_PROGRESS for 2s [ 761.170304] env[65455]: INFO networking_nsxv3.common.synchronization [req-74a1f85d-84d5-4e46-b0f8-6000db793f0c req-0649b715-8afb-4b2f-95ff-c9914b5f7c1c tempest-ServerActionsV293TestJSON-876038749 tempest-ServerActionsV293TestJSON-876038749-project-member] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 761.171847] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 761.171847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.172106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.172106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.172269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.172571] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.172571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.172571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.172756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.172835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.172940] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.177977] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96905b57-3285-43c8-99f7-2f66d28aafa1: rpc.has_security_group_logging(os_id): False [ 761.200179] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.200179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.200179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.200342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.200549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.200624] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.200726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.200789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.200949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.201041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.201222] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.201400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.201400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.201531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.201580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.201749] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.201839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.201900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.202423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.202552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.202646] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be updated. [ 761.291053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.295192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.295192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.295192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.295192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.317398] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 761.392508] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 46s [ 761.676815] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.676815] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.676815] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50ff894b-9924-4f71-b210-20859560462d already deleted. [ 761.676815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.730411] env[65455]: INFO networking_nsxv3.common.synchronization [req-af775f03-a0bb-4594-9fc4-d5f68701314f req-474d0bda-18c0-465f-ae89-5d0928e7270a tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 761.730411] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 761.730411] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.730878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.731181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.732116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.732116] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.732116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.732116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.732116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.732116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.732526] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.897836] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.898246] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-11" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.898246] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-11" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.898594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-11" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.898875] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.899192] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.899395] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.899670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.899979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.900311] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.900664] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.900664] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.900783] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.900907] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.901041] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.901152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.926613] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.926805] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.926967] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.927207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-11" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.927538] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.927717] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.927830] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.928207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.928347] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.238097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.238097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.238097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.238097] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 762.308023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.308023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.308023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.308023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.308023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.320563] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 762.430613] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.431011] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.431224] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.431837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.431837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.431959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d not found, creating... [ 762.432314] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.433634] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.433634] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.433634] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.433634] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.434508] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.435363] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.435534] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.435901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.436310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.436365] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d is going to be created. [ 762.497532] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.497868] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.498016] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.498324] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.498592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.498841] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.525078] env[65455]: INFO networking_nsxv3.common.synchronization [req-50766ac6-f26b-4422-a9ee-9e6189b26c79 req-32aaf83e-49d8-4911-84d6-9f3b95994ad4 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 762.525251] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 762.525609] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.526060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.526060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.526259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.526388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.526500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.526557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.526724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.526815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.526910] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.753966] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af in Status: SUCCESS [ 762.754183] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af deletion is rescheduled due to dependency. [ 762.754304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.029703] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.118580] env[65455]: INFO networking_nsxv3.common.synchronization [req-50766ac6-f26b-4422-a9ee-9e6189b26c79 req-16af79b0-585c-4b17-b040-11404df023b5 tempest-ServersTestMultiNic-767262697 tempest-ServersTestMultiNic-767262697-project-member] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 763.119751] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGHEST for action security_group_members [ 763.120137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.120244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.241852] env[65455]: INFO networking_nsxv3.common.synchronization [req-74a1f85d-84d5-4e46-b0f8-6000db793f0c req-f684a82a-a4c1-47ce-ba47-6cbf6740feb9 service nova] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 763.241852] env[65455]: INFO networking_nsxv3.common.synchronization [req-74a1f85d-84d5-4e46-b0f8-6000db793f0c req-f684a82a-a4c1-47ce-ba47-6cbf6740feb9 service nova] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 763.241852] env[65455]: INFO networking_nsxv3.common.synchronization [req-74a1f85d-84d5-4e46-b0f8-6000db793f0c req-f684a82a-a4c1-47ce-ba47-6cbf6740feb9 service nova] Enqueued Resource ID: 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d with Priority: HIGHEST for action port [ 763.242248] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_rules [ 763.242248] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 763.242248] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d with Priority: HIGHEST for action port [ 763.242505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.242726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.242776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.243031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.243104] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.244400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.244400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.244670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.244670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.245803] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.245803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.245803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.245803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.245803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.245803] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.247350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.247531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.247531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.247757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.247821] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.334738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 763.335121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.407376] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 48s [ 763.532382] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.749949] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.750943] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.751337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.753018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d with status ACTIVE [ 763.753018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.753018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.753018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.753018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.756283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.756283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.756283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.756283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.756283] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d is going to be updated. [ 763.787070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.787258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.787329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.787538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.787694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.787941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0a8386-7ed6-4dcd-b5cf-b7dfe506447d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.035115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.035330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.035330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.035557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.035650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.035753] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 764.081133] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.081299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.081378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.081627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.081846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.092694] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 764.257404] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.333377] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 764.333555] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 764.333683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.761429] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.762190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.762632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.762632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.763876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.763876] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50ff894b-9924-4f71-b210-20859560462d is going to be created. [ 764.791729] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.791922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.791970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.792234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.793119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.807152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: UNINITIALIZED for 2s [ 765.203388] env[65455]: INFO networking_nsxv3.common.synchronization [None req-895b19b2-206e-4c95-b3b6-3d0f2730bd9c None None] Enqueued Resource ID: 01fdcc7e-85a4-4159-abb4-aed628900a32 with Priority: HIGHEST for action port [ 765.203824] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01fdcc7e-85a4-4159-abb4-aed628900a32 with Priority: HIGHEST for action port [ 765.204295] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-01fdcc7e-85a4-4159-abb4-aed628900a32 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.204482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01fdcc7e-85a4-4159-abb4-aed628900a32" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.204618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01fdcc7e-85a4-4159-abb4-aed628900a32" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.204917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01fdcc7e-85a4-4159-abb4-aed628900a32" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.207081] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01fdcc7e-85a4-4159-abb4-aed628900a32',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.423723] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 50s [ 765.709845] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01fdcc7e-85a4-4159-abb4-aed628900a32 [ 765.710161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.710805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.710925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.711209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.711713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.715157] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01fdcc7e-85a4-4159-abb4-aed628900a32 already deleted. [ 765.715157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01fdcc7e-85a4-4159-abb4-aed628900a32" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.106493] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.106493] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.106493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.106493] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.531025] env[65455]: INFO networking_nsxv3.common.synchronization [None req-833c6380-dfec-4b24-a877-324b1b400e35 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: dffd4e40-3242-4873-aa8d-327606f53fb0 with Priority: HIGHEST for action security_group_rules [ 766.532032] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffd4e40-3242-4873-aa8d-327606f53fb0 with Priority: HIGHEST for action security_group_rules [ 766.532032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dffd4e40-3242-4873-aa8d-327606f53fb0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.532681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.532796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.533191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.533302] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dffd4e40-3242-4873-aa8d-327606f53fb0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.609772] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.609772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.609772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.609772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.610096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.610096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.610179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.610277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.610500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.610500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.610613] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be updated. [ 766.640676] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.640676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.640676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.640941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.641053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.648783] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8480c23a-4cbc-49e1-844d-8429335e4258 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: dffd4e40-3242-4873-aa8d-327606f53fb0 with Priority: HIGHEST for action security_group_rules [ 766.649358] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dffd4e40-3242-4873-aa8d-327606f53fb0 with Priority: HIGHEST for action security_group_rules [ 766.649668] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dffd4e40-3242-4873-aa8d-327606f53fb0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.649771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.651187] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: IN_PROGRESS for 2s [ 766.819794] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: SUCCESS [ 766.820036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.820584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.820816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.821256] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.821256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.821256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.821466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.821554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.821640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.821743] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.060774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.061535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.061535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.062921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.062921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.062921] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dffd4e40-3242-4873-aa8d-327606f53fb0 already deleted. [ 767.062921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.062921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.062921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.062921] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dffd4e40-3242-4873-aa8d-327606f53fb0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.326674] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.441707] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 52s [ 767.585021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.585351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.585351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.586319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.587396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.587396] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dffd4e40-3242-4873-aa8d-327606f53fb0 already deleted. [ 767.587396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dffd4e40-3242-4873-aa8d-327606f53fb0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.829572] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50ff894b-9924-4f71-b210-20859560462d: rpc.has_security_group_logging(os_id): False [ 767.864360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.864360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.864360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.864360] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50ff894b-9924-4f71-b210-20859560462d is going to be created. [ 767.920735] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e5c5612-a5df-4d71-90fb-9c0a2ecb97e0 req-45f38068-0a36-4bbb-b7d4-6c97287ed714 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 767.921464] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 767.921838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.922028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.922292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.922812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.926328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.926810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.926810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.927079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.927079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.927722] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.932874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.932874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.932874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.932874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.933169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.945866] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: IN_PROGRESS for 2s [ 768.031196] env[65455]: INFO networking_nsxv3.common.synchronization [None req-4f1ef5b7-5c58-47d4-ae53-1826e08a6ef2 None None] Enqueued Resource ID: 659b40b5-1180-4b2d-8fbf-88c848558332 with Priority: HIGHEST for action port [ 768.031196] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659b40b5-1180-4b2d-8fbf-88c848558332 with Priority: HIGHEST for action port [ 768.031886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-659b40b5-1180-4b2d-8fbf-88c848558332 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.031886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-659b40b5-1180-4b2d-8fbf-88c848558332" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.031886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-659b40b5-1180-4b2d-8fbf-88c848558332" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.032238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-659b40b5-1180-4b2d-8fbf-88c848558332" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.032300] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('659b40b5-1180-4b2d-8fbf-88c848558332',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.343025] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.343221] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.343347] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.343617] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.343875] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.344044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.344161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.344378] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.344522] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.344725] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.344863] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.344988] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.345109] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.345219] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.345323] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.345452] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.366171] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.366406] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.366598] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.366833] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.367324] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-12912652-7bf7-477f-8c31-8c538fdcf829 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.367568] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.367788] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.368244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.368435] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12912652-7bf7-477f-8c31-8c538fdcf829',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.436092] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.436311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.436362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.436590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.436686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.436876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.436973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.437049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.437258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.437398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.437398] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 768.463789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.463950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.464036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.464252] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.464392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.476267] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 768.534102] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 659b40b5-1180-4b2d-8fbf-88c848558332 [ 768.534343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.534499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.534591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.534900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.535065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.535152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:659b40b5-1180-4b2d-8fbf-88c848558332 already deleted. [ 768.535241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-659b40b5-1180-4b2d-8fbf-88c848558332" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.660573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c in Status: SUCCESS [ 768.660890] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c deletion is rescheduled due to dependency. [ 768.660890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.870783] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.871030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.871161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.871441] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.871596] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.871806] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 12912652-7bf7-477f-8c31-8c538fdcf829 not found, creating... [ 768.872227] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.872493] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.872641] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.872989] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.873415] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.873651] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.873889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.874267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.874622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.874839] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.875306] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 12912652-7bf7-477f-8c31-8c538fdcf829 is going to be created. [ 768.901061] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.901340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.901487] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.901830] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.902285] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.902564] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.455994] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 54s [ 769.617351] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e5c5612-a5df-4d71-90fb-9c0a2ecb97e0 req-70dcbf50-c421-41b5-9126-ade5bd6405f5 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 769.618447] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e5c5612-a5df-4d71-90fb-9c0a2ecb97e0 req-70dcbf50-c421-41b5-9126-ade5bd6405f5 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 769.618447] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e5c5612-a5df-4d71-90fb-9c0a2ecb97e0 req-70dcbf50-c421-41b5-9126-ade5bd6405f5 service nova] Enqueued Resource ID: 12912652-7bf7-477f-8c31-8c538fdcf829 with Priority: HIGHEST for action port [ 769.618447] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 769.618692] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 769.619388] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12912652-7bf7-477f-8c31-8c538fdcf829 with Priority: HIGHEST for action port [ 769.619911] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.620090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.620182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.620461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.620582] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.622095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.622095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.622278] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-12912652-7bf7-477f-8c31-8c538fdcf829 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.622378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.622461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.622642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.622723] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12912652-7bf7-477f-8c31-8c538fdcf829',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.960018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: SUCCESS [ 769.960358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.123962] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.124104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.127608] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12912652-7bf7-477f-8c31-8c538fdcf829 with status ACTIVE [ 770.127608] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.127608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.127608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.127608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.127608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.127608] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.127950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.127950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.127950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.127950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.128942] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.129163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.129241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.131651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.131651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.131651] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12912652-7bf7-477f-8c31-8c538fdcf829 is going to be updated. [ 770.152277] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.152433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.152550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.153162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.153162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.153162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12912652-7bf7-477f-8c31-8c538fdcf829" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.491026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 770.491026] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 770.491026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.491026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.491450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.491450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.491450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.491648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.491693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.491764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.491880] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.994277] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.470600] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 56s [ 771.496981] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.712478] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7532be3f-c7cb-42fc-8e2a-a47b4a41114c tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 with Priority: HIGHEST for action security_group_rules [ 771.713572] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 with Priority: HIGHEST for action security_group_rules [ 771.714782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80669a7b-57ce-4e1a-b515-afe0e48786c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.716211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.716211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.716211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.716211] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80669a7b-57ce-4e1a-b515-afe0e48786c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.886331] env[65455]: INFO networking_nsxv3.common.synchronization [None req-52963a73-af7d-4c64-957b-702da7033e3a tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 with Priority: HIGHEST for action security_group_rules [ 771.886331] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 with Priority: HIGHEST for action security_group_rules [ 771.886635] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80669a7b-57ce-4e1a-b515-afe0e48786c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.886772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.001196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.001196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.001196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.001196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.001196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.001573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 772.035159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.037890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.037890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.037890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.037890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.046560] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 772.239015] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.239162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.239237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.239869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.239971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.240079] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 already deleted. [ 772.240170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.243055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.243055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.243055] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80669a7b-57ce-4e1a-b515-afe0e48786c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.737563] env[65455]: INFO networking_nsxv3.common.synchronization [req-d5dfaf9e-efc3-405b-bed4-ff864600dd8a req-18330527-9d1f-4b4a-a310-3b21199b0879 tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 772.738136] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 772.738438] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.738559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.738625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.738824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.738972] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.742167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.742167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.742357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.742449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.742547] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.767023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.767297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.767297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.767471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.767562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.767657] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80669a7b-57ce-4e1a-b515-afe0e48786c0 already deleted. [ 772.767740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80669a7b-57ce-4e1a-b515-afe0e48786c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.247149] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.432157] env[65455]: INFO networking_nsxv3.common.synchronization [None req-86a9553f-4e0f-484e-83ef-d214a2766c73 None None] Enqueued Resource ID: 10d03b8f-93ff-42cc-a729-0d776d12e53d with Priority: HIGHEST for action port [ 773.433054] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10d03b8f-93ff-42cc-a729-0d776d12e53d with Priority: HIGHEST for action port [ 773.433054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-10d03b8f-93ff-42cc-a729-0d776d12e53d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.433054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10d03b8f-93ff-42cc-a729-0d776d12e53d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.433054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10d03b8f-93ff-42cc-a729-0d776d12e53d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.434702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10d03b8f-93ff-42cc-a729-0d776d12e53d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.434702] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10d03b8f-93ff-42cc-a729-0d776d12e53d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.485357] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 58s [ 773.752857] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.939813] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10d03b8f-93ff-42cc-a729-0d776d12e53d [ 773.941097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.941285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.941365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.941645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.941760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.941864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10d03b8f-93ff-42cc-a729-0d776d12e53d already deleted. [ 773.941953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10d03b8f-93ff-42cc-a729-0d776d12e53d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.062059] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.062059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.062059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.062059] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.257078] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.257078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.257078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.257078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.257078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.257733] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 774.291395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.291552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.291687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.292100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.292100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.302199] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 774.565238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.566468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.566675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.567028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.567315] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.567500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.567612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.567821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.567966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.568157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.568389] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.568850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.569704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.569899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.570129] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.570321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.570481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.570736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.570876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.572458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.572573] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.903058] env[65455]: INFO networking_nsxv3.common.synchronization [req-a8071c3c-b761-4ef4-ba69-45c10b92b612 req-e472532a-b4e2-4432-a1cd-ddb1cd6d7294 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 774.903943] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 774.905413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.905557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.905627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.905900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.906104] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.906234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.906352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.906528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.906634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.906730] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.082047] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 775.101311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.101500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.101565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.101796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.101886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.102132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.102232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.102295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.102453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.102525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.102868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.102868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.102868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.103062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.103157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.103288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.103375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.103443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.104942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.104942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.104942] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 775.167385] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.167559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.167673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.168776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.170684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.191773] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 775.410059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.410374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.410555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.410974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.411205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.411572] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.411777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.411903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.412280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.412280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.414838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 already deleted. [ 775.414838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.485430] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.485884] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.485884] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.487987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.487987] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.487987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.487987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.488224] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.488354] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.488613] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.488741] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.488857] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.489011] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.489274] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.489712] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.489712] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.508215] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 60s [ 775.514201] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.514563] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.514848] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.515110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.515531] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.515843] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.516026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.516441] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.516659] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a00adc-50a9-4e29-82d1-34a9ea8b4b80',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.019752] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.019888] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.019933] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.020387] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.020387] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.020517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 not found, creating... [ 776.020778] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.020941] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.021052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.021295] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.021426] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.021745] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.021847] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.021956] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.022411] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.022581] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.022841] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 is going to be created. [ 776.049572] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.049572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.049572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.049572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.049572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.049572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.243294] env[65455]: INFO networking_nsxv3.common.synchronization [None req-27ff3284-f7f3-4c36-a7b2-b6d4243fbbfe None None] Enqueued Resource ID: 1dbfb29c-e56b-43d9-b744-778b15d6a308 with Priority: HIGHEST for action port [ 776.243938] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dbfb29c-e56b-43d9-b744-778b15d6a308 with Priority: HIGHEST for action port [ 776.245371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dbfb29c-e56b-43d9-b744-778b15d6a308 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.245582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dbfb29c-e56b-43d9-b744-778b15d6a308" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.245734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dbfb29c-e56b-43d9-b744-778b15d6a308" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.245902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dbfb29c-e56b-43d9-b744-778b15d6a308" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.245994] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dbfb29c-e56b-43d9-b744-778b15d6a308',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.314778] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 776.316721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.748923] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1dbfb29c-e56b-43d9-b744-778b15d6a308 [ 776.749275] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.749418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.749491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.750152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.750152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.750152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1dbfb29c-e56b-43d9-b744-778b15d6a308 already deleted. [ 776.750152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dbfb29c-e56b-43d9-b744-778b15d6a308" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.867482] env[65455]: INFO networking_nsxv3.common.synchronization [req-a8071c3c-b761-4ef4-ba69-45c10b92b612 req-4f6c2553-0d3c-46a9-96a0-d3eac233a42f service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 776.867482] env[65455]: INFO networking_nsxv3.common.synchronization [req-a8071c3c-b761-4ef4-ba69-45c10b92b612 req-4f6c2553-0d3c-46a9-96a0-d3eac233a42f service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 776.867482] env[65455]: INFO networking_nsxv3.common.synchronization [req-a8071c3c-b761-4ef4-ba69-45c10b92b612 req-4f6c2553-0d3c-46a9-96a0-d3eac233a42f service nova] Enqueued Resource ID: b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 with Priority: HIGHEST for action port [ 776.870139] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 776.870139] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 776.870278] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 with Priority: HIGHEST for action port [ 776.870601] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.870727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.870800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.871157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.871250] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.872193] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.872314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.872377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.873577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.873577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.873577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.873577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.873577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.873854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.873854] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.874680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.874807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.875810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.877450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.877450] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0a00adc-50a9-4e29-82d1-34a9ea8b4b80',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.208543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 777.208883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.378879] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.379787] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.379938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.381836] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 with status ACTIVE [ 777.381836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.381836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.381836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.381836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.382759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.382759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.382922] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0a00adc-50a9-4e29-82d1-34a9ea8b4b80 is going to be updated. [ 777.412094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.412233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.412233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.413851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.413851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.413851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0a00adc-50a9-4e29-82d1-34a9ea8b4b80" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.524258] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 62s [ 777.881765] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.888508] env[65455]: INFO networking_nsxv3.common.synchronization [req-86f02cbf-fd0c-433e-920a-7146f58d4e5f req-c94b8ce9-6dcb-424b-9da3-f13070808e03 tempest-ServersTestBootFromVolume-994483071 tempest-ServersTestBootFromVolume-994483071-project-member] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 777.888988] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 777.889602] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.889602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.889750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.890715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.891032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.891153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.891219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.891397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.891485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.891583] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.304015] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:0 completed [ 778.304015] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:1 started [ 778.386095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.386726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.386726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.386826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.386947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.387116] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be created. [ 778.397780] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.397780] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.397780] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd already deleted. [ 778.397780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.415243] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.415448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.415448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.415643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.415793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.428180] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: UNINITIALIZED for 2s [ 778.706675] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5438ef12-78b0-4f2d-83dc-f774e416865d None None] Enqueued Resource ID: fb778cef-07a5-4f4a-b9d8-6214250aa735 with Priority: HIGHEST for action port [ 778.707904] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb778cef-07a5-4f4a-b9d8-6214250aa735 with Priority: HIGHEST for action port [ 778.708727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb778cef-07a5-4f4a-b9d8-6214250aa735 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.708873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb778cef-07a5-4f4a-b9d8-6214250aa735" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.708945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb778cef-07a5-4f4a-b9d8-6214250aa735" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.709230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb778cef-07a5-4f4a-b9d8-6214250aa735" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.710352] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb778cef-07a5-4f4a-b9d8-6214250aa735',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.120670] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.120670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-934" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.120670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-934" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.120670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-934" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.120670] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.120670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.120670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.122349] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.122349] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.122349] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.122349] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.122349] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.122349] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.122349] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 779.122349] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.122349] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.143121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.143287] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 779.143420] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.143596] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-934" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.143910] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-e7009c2f-16fa-4b6a-8635-41d4e82565e1 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.144090] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.144217] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.144589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.144738] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7009c2f-16fa-4b6a-8635-41d4e82565e1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.219166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb778cef-07a5-4f4a-b9d8-6214250aa735 [ 779.219409] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.219624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.219726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.220164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.220164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.220285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb778cef-07a5-4f4a-b9d8-6214250aa735 already deleted. [ 779.220466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb778cef-07a5-4f4a-b9d8-6214250aa735" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.541317] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 64s [ 779.650091] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.651643] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port e7009c2f-16fa-4b6a-8635-41d4e82565e1 not found, creating... [ 779.651643] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.651643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.652008] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.652008] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.652092] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.652273] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.652475] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.652602] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.652735] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: e7009c2f-16fa-4b6a-8635-41d4e82565e1 is going to be created. [ 779.677831] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.678428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.678578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.678859] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.679157] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.679366] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.250429] env[65455]: INFO networking_nsxv3.common.synchronization [None req-fdf1f0b6-f647-4b0d-bd96-85f544f39fd4 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 780.251553] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 780.251553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.251553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.251553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.251852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.251852] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.441663] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 780.441977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.442129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.442357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.442557] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.442755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.442825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.442998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.443641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.443641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.443641] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.543828] env[65455]: INFO networking_nsxv3.common.synchronization [req-86f02cbf-fd0c-433e-920a-7146f58d4e5f req-436d70a5-720b-45c9-be28-c9edcec83ca9 service nova] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 780.544064] env[65455]: INFO networking_nsxv3.common.synchronization [req-86f02cbf-fd0c-433e-920a-7146f58d4e5f req-436d70a5-720b-45c9-be28-c9edcec83ca9 service nova] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 780.544274] env[65455]: INFO networking_nsxv3.common.synchronization [req-86f02cbf-fd0c-433e-920a-7146f58d4e5f req-436d70a5-720b-45c9-be28-c9edcec83ca9 service nova] Enqueued Resource ID: e7009c2f-16fa-4b6a-8635-41d4e82565e1 with Priority: HIGHEST for action port [ 780.544883] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_rules [ 780.545515] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 780.545515] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7009c2f-16fa-4b6a-8635-41d4e82565e1 with Priority: HIGHEST for action port [ 780.545784] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.545784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.545784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.545980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.546081] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.547143] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.547302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.547359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.552691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.552691] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.552691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7009c2f-16fa-4b6a-8635-41d4e82565e1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.552691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.555460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.555549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7009c2f-16fa-4b6a-8635-41d4e82565e1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.676214] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5f97f125-6994-4ce0-b8cd-bc34494e2475 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 780.677189] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 780.677189] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.677282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.779064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.779064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.779237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.779410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.779515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.779616] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 already deleted. [ 780.779704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.779862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.780043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.780130] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.945321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.945490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.945569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.945763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.945940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.946067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.946128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.946333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.946412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.946534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.946618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.946712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.946765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.946911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.947189] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.947189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.947189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.947434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.947434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.947526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.947589] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.057803] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.060533] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.060700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.063229] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7009c2f-16fa-4b6a-8635-41d4e82565e1 with status ACTIVE [ 781.063229] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.063229] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.063229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.063740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.063740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.063740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.063740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.063740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.063740] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7009c2f-16fa-4b6a-8635-41d4e82565e1 is going to be updated. [ 781.092177] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.092337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.092409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.092635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.092777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.092941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7009c2f-16fa-4b6a-8635-41d4e82565e1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.305426] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.305727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.305727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.305886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.305976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.306181] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 already deleted. [ 781.306181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.449594] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 781.472057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.472342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.472494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.473497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.473497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.473640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.475423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.475423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.475786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.475948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.476023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.476348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.476419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.476550] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be created. [ 781.555495] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.555495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.555639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.555746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.555926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.558459] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 66s [ 781.562573] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.571725] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 781.587161] env[65455]: INFO networking_nsxv3.common.synchronization [None req-dad26379-3fc8-4f86-860f-26c2dfa89b0b None None] Enqueued Resource ID: e7018c0d-7b71-4055-82b2-f59abbdb7a9c with Priority: HIGHEST for action port [ 781.588536] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7018c0d-7b71-4055-82b2-f59abbdb7a9c with Priority: HIGHEST for action port [ 781.589454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7018c0d-7b71-4055-82b2-f59abbdb7a9c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.590133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7018c0d-7b71-4055-82b2-f59abbdb7a9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.590133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7018c0d-7b71-4055-82b2-f59abbdb7a9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.590133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7018c0d-7b71-4055-82b2-f59abbdb7a9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.590393] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7018c0d-7b71-4055-82b2-f59abbdb7a9c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.064380] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.064506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.064576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.064877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.065018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.065221] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd is going to be created. [ 782.093334] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7018c0d-7b71-4055-82b2-f59abbdb7a9c [ 782.093606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.093750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.093817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.094064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.094184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.094326] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7018c0d-7b71-4055-82b2-f59abbdb7a9c already deleted. [ 782.094382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7018c0d-7b71-4055-82b2-f59abbdb7a9c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.098420] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.098420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.098420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.098420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.098420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.117174] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: UNINITIALIZED for 2s [ 783.572638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 68s [ 783.584953] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 783.586402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.626148] env[65455]: INFO networking_nsxv3.common.synchronization [req-9f7f2c62-a398-451d-ad07-d5e636c83de5 req-76a936c5-ca07-40f7-9a5e-1ab5a121e796 tempest-AttachInterfacesV270Test-1466687470 tempest-AttachInterfacesV270Test-1466687470-project-member] Enqueued Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 783.628395] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 783.628767] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.628893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.628959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.630126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.630284] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.630457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.630617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.630700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.630793] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.130151] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: SUCCESS [ 784.130433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.130662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.130891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.131097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.131276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.131382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.131571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.131664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.131797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.131923] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.137258] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.137413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.137413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.137875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.137875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.137988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.139023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.139023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.139023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.139023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.139023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 already deleted. [ 784.139023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.610313] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.610662] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-581" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.610662] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-581" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.611127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-581" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.615023] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.615023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.615023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.615023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.615023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.615023] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.615023] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.615023] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.615023] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.615023] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 784.615023] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.615023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.634062] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.634320] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 784.634481] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.634654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-581" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.634965] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-d07bfb35-4786-45de-87aa-2e41d0e8a91f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.635140] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.635250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.635740] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.635870] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d07bfb35-4786-45de-87aa-2e41d0e8a91f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.637631] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.140631] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.140876] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.140876] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.141228] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.141376] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.141545] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port d07bfb35-4786-45de-87aa-2e41d0e8a91f not found, creating... [ 785.141862] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.142038] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.142155] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.142603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.142603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.142857] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.143019] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.143134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.143358] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.143493] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.143632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: d07bfb35-4786-45de-87aa-2e41d0e8a91f is going to be created. [ 785.145040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45b5142c-4bc9-41fd-a039-af08feb308fd: rpc.has_security_group_logging(os_id): False [ 785.174381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.174540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.174611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.174833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.174922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.175178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.175279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.175341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.175496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.175571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.175654] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd is going to be created. [ 785.182529] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.182795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.182957] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.183596] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.183596] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.183987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.283027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.283254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.283351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.283618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.283825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.294570] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f0323ff-a176-407b-9237-66dee1a11b90 req-2f92873d-b265-40a7-8ad8-7da566f78fc8 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 785.295336] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 785.296123] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.296123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.296123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.296410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.296410] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.296566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.296682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.296888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.297079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.297167] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.307549] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: IN_PROGRESS for 2s [ 785.330279] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f0323ff-a176-407b-9237-66dee1a11b90 req-2f92873d-b265-40a7-8ad8-7da566f78fc8 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 785.330474] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f0323ff-a176-407b-9237-66dee1a11b90 req-2f92873d-b265-40a7-8ad8-7da566f78fc8 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 785.330610] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f0323ff-a176-407b-9237-66dee1a11b90 req-2f92873d-b265-40a7-8ad8-7da566f78fc8 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 785.331216] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 785.331393] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 785.331550] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 785.331880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.332015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.332072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.332284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.332371] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.333390] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.333532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.333635] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-45447620-7790-4a01-ba84-10cddc5ed4bf taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.333735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.333793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.333968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.334171] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45447620-7790-4a01-ba84-10cddc5ed4bf',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.588355] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 70s [ 785.799285] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.836875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.836875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.836875] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45447620-7790-4a01-ba84-10cddc5ed4bf with status ACTIVE [ 785.837531] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.837683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.837971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.838078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.838179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.838448] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.838904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.838904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.838904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.839118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.839332] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.839457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.839548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.840322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.840444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.840572] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45447620-7790-4a01-ba84-10cddc5ed4bf is going to be updated. [ 785.887620] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.887863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.887863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.888147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.888307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.888481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.948241] env[65455]: INFO networking_nsxv3.common.synchronization [req-9f7f2c62-a398-451d-ad07-d5e636c83de5 req-5b2c5ba5-dea5-4261-b70e-60f9cf6165fb service nova] Enqueued Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_rules [ 785.948564] env[65455]: INFO networking_nsxv3.common.synchronization [req-9f7f2c62-a398-451d-ad07-d5e636c83de5 req-5b2c5ba5-dea5-4261-b70e-60f9cf6165fb service nova] Enqueued Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 785.948808] env[65455]: INFO networking_nsxv3.common.synchronization [req-9f7f2c62-a398-451d-ad07-d5e636c83de5 req-5b2c5ba5-dea5-4261-b70e-60f9cf6165fb service nova] Enqueued Resource ID: d07bfb35-4786-45de-87aa-2e41d0e8a91f with Priority: HIGHEST for action port [ 785.949678] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_rules [ 785.949898] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 785.950100] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d07bfb35-4786-45de-87aa-2e41d0e8a91f with Priority: HIGHEST for action port [ 785.950518] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.950710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.950819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.951225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.951364] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.952689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.952988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953865] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.955242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.955434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.955694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.955854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.956024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.957355] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d07bfb35-4786-45de-87aa-2e41d0e8a91f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.957440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.957550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.957818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.957950] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d07bfb35-4786-45de-87aa-2e41d0e8a91f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.303380] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.460456] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.461224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.461399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.461489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d07bfb35-4786-45de-87aa-2e41d0e8a91f with status ACTIVE [ 786.461650] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.461792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.462082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.462082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.462196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.462311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.462436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.462529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.462710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.462809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.463604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.463770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.463826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.463999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.464230] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d07bfb35-4786-45de-87aa-2e41d0e8a91f is going to be updated. [ 786.488971] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.489127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.489202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.489441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.489718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.490505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d07bfb35-4786-45de-87aa-2e41d0e8a91f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.806171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.806596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.806596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.806709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.806866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.806990] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 786.844246] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.844246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.844650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.844650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.845254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.857039] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 786.938024] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7814c743-76b2-41ed-945a-836ca200404d None None] Enqueued Resource ID: b4a214d7-e679-42e8-b221-fc6211daf79b with Priority: HIGHEST for action port [ 786.938024] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a214d7-e679-42e8-b221-fc6211daf79b with Priority: HIGHEST for action port [ 786.938024] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4a214d7-e679-42e8-b221-fc6211daf79b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.938024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4a214d7-e679-42e8-b221-fc6211daf79b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.938950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4a214d7-e679-42e8-b221-fc6211daf79b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.939379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4a214d7-e679-42e8-b221-fc6211daf79b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.939783] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a214d7-e679-42e8-b221-fc6211daf79b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.967696] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.327040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: SUCCESS [ 787.327194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.443561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4a214d7-e679-42e8-b221-fc6211daf79b [ 787.443792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.444095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.444095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.444724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.444724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.444724] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4a214d7-e679-42e8-b221-fc6211daf79b already deleted. [ 787.444724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4a214d7-e679-42e8-b221-fc6211daf79b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.468969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.471975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.471975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.472594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.472682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.472842] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 is going to be created. [ 787.502446] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.502789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.502879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.503100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.503273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.515937] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: UNINITIALIZED for 2s [ 787.606089] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 72s [ 788.867430] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 788.867811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.867926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.868182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.868395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.868554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.868629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.868833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.869155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.869345] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.332547] env[65455]: INFO networking_nsxv3.common.synchronization [req-c09d98f8-1cf6-4e8c-a786-69e7d4aaa77e req-674e4d09-f5b3-439f-a1de-8c157c6e335f tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 789.334113] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 789.334589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.334720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.334842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.335182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.335182] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.335292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.335366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.335524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.335630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.335747] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.371827] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.528548] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: SUCCESS [ 789.528781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.528953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.529244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.529488] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.529619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.529685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.529850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.529932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.530031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.530120] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.620458] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 74s [ 789.634817] env[65455]: INFO networking_nsxv3.common.synchronization [None req-88ab5121-3113-457c-a336-5726f2cbba78 None None] Enqueued Resource ID: 8ec9a5df-19a8-487e-bb2f-6453a2317c58 with Priority: HIGHEST for action port [ 789.635558] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec9a5df-19a8-487e-bb2f-6453a2317c58 with Priority: HIGHEST for action port [ 789.635941] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec9a5df-19a8-487e-bb2f-6453a2317c58 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.636140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec9a5df-19a8-487e-bb2f-6453a2317c58" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.636237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec9a5df-19a8-487e-bb2f-6453a2317c58" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.636634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec9a5df-19a8-487e-bb2f-6453a2317c58" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.637015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec9a5df-19a8-487e-bb2f-6453a2317c58',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.839768] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.840074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.840251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.840576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.864715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.864715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.864715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.864715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.865042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.865113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.865230] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be updated. [ 789.875098] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.897779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.898017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.898135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.898463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.898692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.911155] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: IN_PROGRESS for 2s [ 790.032603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.032810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.032905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.033207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.033416] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.033555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.033645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.033877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.034022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.034152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.034435] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.034613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.034659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.034826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.035026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.035127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.035194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.035399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.035504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.035611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.035748] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.139627] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ec9a5df-19a8-487e-bb2f-6453a2317c58 [ 790.139810] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.139810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.139950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.140136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.140233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.140333] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ec9a5df-19a8-487e-bb2f-6453a2317c58 already deleted. [ 790.140414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec9a5df-19a8-487e-bb2f-6453a2317c58" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.380097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.380332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.380385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.380904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.381033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.381166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 790.417318] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.417555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.417555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.417751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.417899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.429287] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 790.538804] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e805e5ac-07cc-4195-97d9-60139abf3cc5: rpc.has_security_group_logging(os_id): False [ 790.563820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.564107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.564107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.564368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.564481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.564690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.564790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.564856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.565035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.565121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.565316] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.565413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.565474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.565619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.565715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.565917] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.566030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.566083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.566225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.566298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.566453] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 is going to be created. [ 790.643707] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.643939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.643939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.644157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.644343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.656576] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: IN_PROGRESS for 2s [ 791.635235] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 76s [ 791.923738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 791.923916] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 deletion is rescheduled due to dependency. [ 791.923998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.440644] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 792.440962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.441196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.441443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.441662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.441796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.441865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.442059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.442153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.442245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.442337] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.670932] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: SUCCESS [ 792.671355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.944496] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.450563] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c: rpc.has_security_group_logging(os_id): False [ 793.473103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.473103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.473103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.473103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.473103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.474165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.474165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.474500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.474623] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 793.544562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.545209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.545209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.545209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.545209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.559735] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 793.695205] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 793.695594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.636977] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 794.638435] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 795.578147] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 795.578533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.687870] env[65455]: INFO networking_nsxv3.common.synchronization [req-4d0c1617-e260-4ffa-aead-3dcc3f309629 req-dbe024f2-b241-4016-9e52-e4126a5e16c5 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 795.688423] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 795.688717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.688838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.688905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.690333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.690508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.690618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.690683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.690874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.690930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.691034] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.707767] env[65455]: INFO networking_nsxv3.common.synchronization [req-4d0c1617-e260-4ffa-aead-3dcc3f309629 req-dbe024f2-b241-4016-9e52-e4126a5e16c5 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 795.707767] env[65455]: INFO networking_nsxv3.common.synchronization [req-4d0c1617-e260-4ffa-aead-3dcc3f309629 req-dbe024f2-b241-4016-9e52-e4126a5e16c5 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 795.707767] env[65455]: INFO networking_nsxv3.common.synchronization [req-4d0c1617-e260-4ffa-aead-3dcc3f309629 req-dbe024f2-b241-4016-9e52-e4126a5e16c5 tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 795.707767] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_rules [ 795.707767] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 795.707953] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45447620-7790-4a01-ba84-10cddc5ed4bf with Priority: HIGHEST for action port [ 795.708222] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.708323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.708360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.708539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.708619] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.709442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.709584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.709726] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-45447620-7790-4a01-ba84-10cddc5ed4bf taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.709826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.709899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.710075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.710151] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45447620-7790-4a01-ba84-10cddc5ed4bf',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.193195] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.212077] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.212215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.215896] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45447620-7790-4a01-ba84-10cddc5ed4bf with status ACTIVE [ 796.216120] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.216240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.216308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.216588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.216679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.216856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.216948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.217016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.217166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.217239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.217416] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.217525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.217590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.217731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.217804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.217889] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45447620-7790-4a01-ba84-10cddc5ed4bf is going to be updated. [ 796.220910] env[65455]: INFO networking_nsxv3.common.synchronization [req-d4f6c5ab-6c99-4d17-8d5f-1069ae6480f4 req-bfa7c19c-34ee-49d2-a76f-b1324724e147 tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 796.221417] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 796.221701] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.221962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.221962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.222092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.222317] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.222317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.222425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.222504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.222557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.222650] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.241762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.241952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.241952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.242141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.242332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.243651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45447620-7790-4a01-ba84-10cddc5ed4bf" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.697267] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.726951] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.726951] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.726951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.726951] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 796.734142] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.734577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.734845] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.735230] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.735666] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.735998] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.736254] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.736688] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.736950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.737294] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.737635] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.737962] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.738399] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.738399] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.739026] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.739026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.774985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.775169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.775238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.775460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.775606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.778381] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.778542] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.778697] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.778849] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.779171] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.779339] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.779453] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.779784] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.779923] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9987180d-f992-4a8f-b0cd-7bb8a4695d2f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.785546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 797.200384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.202302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.202302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202302] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 797.233893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.234130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.234228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.234509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.234692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.245970] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 797.282073] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.282533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.282533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.282749] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.282896] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.283087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 9987180d-f992-4a8f-b0cd-7bb8a4695d2f not found, creating... [ 797.283368] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.283515] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.283620] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.283868] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.284069] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.284387] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.284532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.284621] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.285221] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.285221] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.285221] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 9987180d-f992-4a8f-b0cd-7bb8a4695d2f is going to be created. [ 797.318718] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.318999] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.319207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.319481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.319707] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.319926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.830510] env[65455]: INFO networking_nsxv3.common.synchronization [req-4662c847-7f0e-4221-9f55-9df3e7b8f9d1 req-d9cb1bf9-05b3-480a-ae27-4fef3426aa99 tempest-ServersTestFqdnHostnames-1791544921 tempest-ServersTestFqdnHostnames-1791544921-project-member] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 797.831397] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGHEST for action security_group_members [ 797.832381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.832526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.832595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.832803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.833027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.833197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.833308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.833498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.833587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.833685] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.000398] env[65455]: INFO networking_nsxv3.common.synchronization [req-d4f6c5ab-6c99-4d17-8d5f-1069ae6480f4 req-8781b59d-27dc-42d1-bd7a-44c1b9e0ecab service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 798.000398] env[65455]: INFO networking_nsxv3.common.synchronization [req-d4f6c5ab-6c99-4d17-8d5f-1069ae6480f4 req-8781b59d-27dc-42d1-bd7a-44c1b9e0ecab service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 798.000398] env[65455]: INFO networking_nsxv3.common.synchronization [req-d4f6c5ab-6c99-4d17-8d5f-1069ae6480f4 req-8781b59d-27dc-42d1-bd7a-44c1b9e0ecab service nova] Enqueued Resource ID: 9987180d-f992-4a8f-b0cd-7bb8a4695d2f with Priority: HIGHEST for action port [ 798.000841] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 798.000841] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 798.000841] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9987180d-f992-4a8f-b0cd-7bb8a4695d2f with Priority: HIGHEST for action port [ 798.002443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.002443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.002443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.002443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.002443] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.002443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.002720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.002720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.003552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.003552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.003552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.003552] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9987180d-f992-4a8f-b0cd-7bb8a4695d2f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.336808] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.337141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.337141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.337291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.363368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.363814] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.364014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.364150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.364477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.364618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.364762] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ec5c2d-0701-464f-b730-022584dac61b is going to be updated. [ 798.403272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.403478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.403478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.403730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.403876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.413843] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: IN_PROGRESS for 2s [ 798.506355] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9987180d-f992-4a8f-b0cd-7bb8a4695d2f with status ACTIVE [ 798.506677] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.506822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.506886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.507116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.507205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.507381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.507497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.507600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.507709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.507787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.507970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.508081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.508131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.508279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.508333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.508416] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9987180d-f992-4a8f-b0cd-7bb8a4695d2f is going to be updated. [ 798.509704] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.509790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.531194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.531312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.531387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.531601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.531741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.531907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9987180d-f992-4a8f-b0cd-7bb8a4695d2f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.797292] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 798.797476] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 798.797730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.798262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.798667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.798667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.798905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.798905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.798982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.799516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.799516] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.993192] env[65455]: INFO networking_nsxv3.common.synchronization [req-f73601a9-fecf-4163-9f88-20926daf6aee req-abfd8cc9-28e7-4146-80a0-00f572030022 tempest-ImagesOneServerTestJSON-1293947550 tempest-ImagesOneServerTestJSON-1293947550-project-member] Enqueued Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 798.994528] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGHEST for action security_group_members [ 798.994528] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.994528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.994528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.994817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.994817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.995021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.995200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.995294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.995631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.995753] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.088204] env[65455]: INFO networking_nsxv3.common.synchronization [req-94a045cb-f4bf-4268-bd23-1f4af6829d55 req-eec84130-599d-483a-87f9-e3413799c977 tempest-ServerDiagnosticsTest-1349326979 tempest-ServerDiagnosticsTest-1349326979-project-member] Enqueued Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 799.089030] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 799.089932] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.090110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.090166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.090406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.091412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.091615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.091695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.091928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.092032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.092135] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.269452] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 799.269452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.269788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.270014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.270550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.270550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.270550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.270866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.270920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.271314] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.302176] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.498509] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.499618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.499911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.500670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.501039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.501497] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.503021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.503021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.503021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.503021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.503021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a is going to be updated. [ 799.545826] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.545826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.545826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.545826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.545826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.555620] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: IN_PROGRESS for 2s [ 799.595245] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.595245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.595245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.595245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.595245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.595671] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.595915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.596105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.596371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.596585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.596771] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed already deleted. [ 799.596945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.666224] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.666453] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.667789] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.668685] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.669179] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.669423] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.669619] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.669889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.670102] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.670345] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.670555] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.670555] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.670658] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.671057] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.671203] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.671339] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.697267] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.697519] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.698778] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.698778] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.698778] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-cbf2918d-22a5-4844-982c-2109b4920501 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.698778] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.698778] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.699058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.699153] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbf2918d-22a5-4844-982c-2109b4920501',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.774715] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.806126] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.202141] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.202556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.202556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.202816] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.202963] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.203120] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port cbf2918d-22a5-4844-982c-2109b4920501 not found, creating... [ 800.203423] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.203579] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.203691] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.203908] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.204054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.204332] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.204481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.204594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.204795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.204923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.205117] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: cbf2918d-22a5-4844-982c-2109b4920501 is going to be created. [ 800.228590] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.229026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.229216] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.229614] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.229945] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.230214] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.277015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.307415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.307673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.307673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.307883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.308094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.308094] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 800.363475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.363475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.363475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.363789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.364024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.376150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 800.428982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57ec5c2d-0701-464f-b730-022584dac61b in Status: SUCCESS [ 800.429201] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57ec5c2d-0701-464f-b730-022584dac61b deletion is rescheduled due to dependency. [ 800.429260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.780813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.780813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.780813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.780813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.780813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.782024] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 800.819173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.821024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.821024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.821024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.821024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.833170] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [req-94a045cb-f4bf-4268-bd23-1f4af6829d55 req-981b3836-baf7-4763-9433-0d5b7f36180c service nova] Enqueued Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_rules [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [req-94a045cb-f4bf-4268-bd23-1f4af6829d55 req-981b3836-baf7-4763-9433-0d5b7f36180c service nova] Enqueued Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [req-94a045cb-f4bf-4268-bd23-1f4af6829d55 req-981b3836-baf7-4763-9433-0d5b7f36180c service nova] Enqueued Resource ID: cbf2918d-22a5-4844-982c-2109b4920501 with Priority: HIGHEST for action port [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_rules [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 800.938103] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbf2918d-22a5-4844-982c-2109b4920501 with Priority: HIGHEST for action port [ 800.938103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.938829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.939040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.939399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.939595] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.940876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.941128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.941414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.941675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.941913] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.942159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.942308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.942551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.942730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.943013] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.944144] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbf2918d-22a5-4844-982c-2109b4920501 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.944765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.944765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.944765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.944765] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbf2918d-22a5-4844-982c-2109b4920501',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.447502] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.447831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.447876] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.448804] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbf2918d-22a5-4844-982c-2109b4920501 with status ACTIVE [ 801.449120] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.449209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.449209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.451314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.451421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.451770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.451770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.451858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.451971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.452121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.452344] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.452448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.452538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.453042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.453042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.453042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbf2918d-22a5-4844-982c-2109b4920501 is going to be updated. [ 801.476181] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.476336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.476405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.476627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.476786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.476973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbf2918d-22a5-4844-982c-2109b4920501" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.570411] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a in Status: SUCCESS [ 801.570675] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a deletion is rescheduled due to dependency. [ 801.570805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.865784] env[65455]: INFO networking_nsxv3.common.synchronization [req-34317a01-330e-4ad2-9630-3cf2f62ab1f5 req-12a8a413-969d-4ec8-8814-10cc9fc76ca1 tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 801.867026] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 801.867454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.867621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.867708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.868083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.868273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.868727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.868851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.869225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.869225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.869334] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.955722] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.338577] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.338976] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.345310] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.345310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.345310] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.345310] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.345929] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.345929] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.345929] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.345929] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.346393] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.370565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.370764] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.370858] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.372012] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.372012] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-1dc2b485-91c0-42eb-b723-997eda919d26 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.372012] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.372012] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.372241] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.372323] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc2b485-91c0-42eb-b723-997eda919d26',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.373561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.373670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.373736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.374085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.374085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.374253] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.374318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.375305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.375305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.375305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.375305] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a already deleted. [ 802.375305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.389413] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 802.389695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.390288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.390509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.390709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.390825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.390893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.391072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.391157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.391245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.391337] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.460265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.460611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.460611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.460907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.461041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.461174] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed is going to be created. [ 802.503488] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.503695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.503754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.503936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.504096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.518219] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: UNINITIALIZED for 2s [ 802.546332] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f9a874c1-f54d-4bdc-97c9-dae598c7a8c7 None None] Enqueued Resource ID: ff29285c-d466-4869-8f9e-2e62b50157a1 with Priority: HIGHEST for action port [ 802.547153] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff29285c-d466-4869-8f9e-2e62b50157a1 with Priority: HIGHEST for action port [ 802.547554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff29285c-d466-4869-8f9e-2e62b50157a1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.547700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff29285c-d466-4869-8f9e-2e62b50157a1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.547769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff29285c-d466-4869-8f9e-2e62b50157a1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.548345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff29285c-d466-4869-8f9e-2e62b50157a1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.548464] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff29285c-d466-4869-8f9e-2e62b50157a1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.847361] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.847361] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.847361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.847361] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.876875] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.877101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.877244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.877577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.877812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.877896] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 1dc2b485-91c0-42eb-b723-997eda919d26 not found, creating... [ 802.878181] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.878361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.878478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.878771] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.878871] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879204] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.879374] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.879516] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.879784] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.879845] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.879954] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 1dc2b485-91c0-42eb-b723-997eda919d26 is going to be created. [ 802.893778] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.893991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.893991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.895021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.895021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.895021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.895021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.895021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.895508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.895508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.895508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.895653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.895932] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.895932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.896087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.896333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.896555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.896693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.896843] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.933594] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.933594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.933594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.933594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.933594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.933594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.051272] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff29285c-d466-4869-8f9e-2e62b50157a1 [ 803.051561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.051714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.051792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.052038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.053019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.053019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff29285c-d466-4869-8f9e-2e62b50157a1 already deleted. [ 803.053019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff29285c-d466-4869-8f9e-2e62b50157a1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.349957] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.402709] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 803.423087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.423087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.423087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.423753] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.423753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.423753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.423753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.423753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.423753] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.424067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.424067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.424370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.424370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.424511] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 803.496700] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.497037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.497037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.497171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.497321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.511117] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [req-34317a01-330e-4ad2-9630-3cf2f62ab1f5 req-223ed153-ef21-4bc6-822d-0e1ffe1b5368 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [req-34317a01-330e-4ad2-9630-3cf2f62ab1f5 req-223ed153-ef21-4bc6-822d-0e1ffe1b5368 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [req-34317a01-330e-4ad2-9630-3cf2f62ab1f5 req-223ed153-ef21-4bc6-822d-0e1ffe1b5368 service nova] Enqueued Resource ID: 1dc2b485-91c0-42eb-b723-997eda919d26 with Priority: HIGHEST for action port [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 803.730073] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1dc2b485-91c0-42eb-b723-997eda919d26 with Priority: HIGHEST for action port [ 803.730073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.730073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.730597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.730597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.730665] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.735977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.735977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.735977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.735977] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.740191] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-1dc2b485-91c0-42eb-b723-997eda919d26 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.740366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.740469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.740727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.740857] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1dc2b485-91c0-42eb-b723-997eda919d26',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.855212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c: rpc.has_security_group_logging(os_id): False [ 803.874955] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.874955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.874955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.875217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.875217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.876064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.876064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.876064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.876064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.876064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.876064] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 803.925126] env[65455]: INFO networking_nsxv3.common.synchronization [req-fd8201ae-74c5-46ed-92b9-d1b29077da13 req-0249d7fd-d006-41f3-b5d4-5f3ffb0e5d2e tempest-AttachInterfacesV270Test-1466687470 tempest-AttachInterfacesV270Test-1466687470-project-member] Enqueued Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 803.926070] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 with Priority: HIGHEST for action security_group_members [ 803.926070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e805e5ac-07cc-4195-97d9-60139abf3cc5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.926297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.926297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.926482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.926640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.926912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.926912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.927013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.927082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.927173] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e805e5ac-07cc-4195-97d9-60139abf3cc5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.960713] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.960919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.962777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.962777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.962777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.976133] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 804.245699] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.246905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.248117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.249239] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1dc2b485-91c0-42eb-b723-997eda919d26 with status ACTIVE [ 804.249343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.249574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.249574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.249759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.249864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.253231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.253231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.253231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.253231] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1dc2b485-91c0-42eb-b723-997eda919d26 is going to be updated. [ 804.280368] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.281193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.281193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.281193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.281193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.281193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1dc2b485-91c0-42eb-b723-997eda919d26" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.429589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.429867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.429867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.430205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.430259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.430525] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.430630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.430698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.430838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.430892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.430979] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 is going to be updated. [ 804.483560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.483742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.483848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.484108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.484302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.496107] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: IN_PROGRESS for 2s [ 804.532265] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: SUCCESS [ 804.532578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.533013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.533111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.534093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.534093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.534093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.534093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.534093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.534093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.534371] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.756983] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.037443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.037734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.037734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.037891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.038185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.038185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.039117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.039117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.039477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.039477] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.039627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.039676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.039793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.039994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.039994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.040091] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.217171] env[65455]: INFO networking_nsxv3.common.synchronization [req-1f9a58c3-b0e1-4d95-94a4-08c7973c6530 req-ec9c8303-4512-427c-8732-73a267c8d25e tempest-AttachInterfacesUnderV243Test-1283599571 tempest-AttachInterfacesUnderV243Test-1283599571-project-member] Enqueued Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 805.217803] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c with Priority: HIGHEST for action security_group_members [ 805.218511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.218845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.218845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.218998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.220038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.220038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.220038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.220038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.220038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.220038] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bcfe12f-28f7-472c-8e5a-1f4d45ae689c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.261678] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.263439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.263439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.263439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.263439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.263439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be created. [ 805.311243] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.311725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.312270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.312270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.312656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.327136] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: UNINITIALIZED for 2s [ 805.375032] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7c48c656-105b-4a78-bd81-e6e68f15670e None None] Enqueued Resource ID: 28b5644c-d799-4897-ba96-21c722384afa with Priority: HIGHEST for action port [ 805.376360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b5644c-d799-4897-ba96-21c722384afa with Priority: HIGHEST for action port [ 805.377202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-28b5644c-d799-4897-ba96-21c722384afa taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.377387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28b5644c-d799-4897-ba96-21c722384afa" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.377509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28b5644c-d799-4897-ba96-21c722384afa" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.377818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28b5644c-d799-4897-ba96-21c722384afa" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.378190] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28b5644c-d799-4897-ba96-21c722384afa',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.527231] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 805.527231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.543852] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d70687e5-a5c2-4fcd-8aab-9c7e15c186ed: rpc.has_security_group_logging(os_id): False [ 805.562204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.562369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.562452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.562647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.562736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.562970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.563074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.563143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.563298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.563390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.563573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.563682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.563743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.563887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.563962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.567328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.568518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.568518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.568518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.568518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.568518] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed is going to be created. [ 805.637289] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.637470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.637537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.637755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.637960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.652105] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: IN_PROGRESS for 2s [ 805.723080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.723231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.723306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.723536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.723643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.723820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.723920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.723982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.724366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.724366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.724489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c is going to be updated. [ 805.726346] env[65455]: INFO networking_nsxv3.common.synchronization [req-80a379fb-d6d1-46e4-83ec-e6d9d49bd9be req-4649052c-09da-47ef-9e1a-3279e53bf3cf tempest-ServerGroupTestJSON-1040491830 tempest-ServerGroupTestJSON-1040491830-project-member] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 805.726924] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 805.732146] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.732337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.732337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.732624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.732787] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.732897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.732988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.733167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.733210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.733311] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.828152] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.828335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.828610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.828754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.829098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.839304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: IN_PROGRESS for 2s [ 805.882622] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28b5644c-d799-4897-ba96-21c722384afa [ 805.882622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.882622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.882622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.882622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.882622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.882622] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28b5644c-d799-4897-ba96-21c722384afa already deleted. [ 805.882622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28b5644c-d799-4897-ba96-21c722384afa" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.996301] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 805.996682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.171532] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-587 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.171765] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-587" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.171887] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-587" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.172405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-587" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.172733] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.172902] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.173109] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.173541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.173541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.173692] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.173802] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.173926] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.174026] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.174135] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.174242] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.174395] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.199926] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.200237] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.200483] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.200813] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-587" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.201534] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-3999230e-1d0e-405a-89ce-1135bcc77331 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.201696] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.201945] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.202394] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.202557] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3999230e-1d0e-405a-89ce-1135bcc77331',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.237878] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.237878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.237878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.238161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.238402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.238652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.239043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.239043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.239043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.239137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.239184] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 already deleted. [ 806.239269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.508406] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 in Status: SUCCESS [ 806.508807] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e805e5ac-07cc-4195-97d9-60139abf3cc5 deletion is rescheduled due to dependency. [ 806.509148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e805e5ac-07cc-4195-97d9-60139abf3cc5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.705557] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.705982] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.706161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.706697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.706921] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.707179] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 3999230e-1d0e-405a-89ce-1135bcc77331 not found, creating... [ 806.707596] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.707877] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.708093] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.708484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.708725] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.709223] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.709457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.709631] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.709954] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.710167] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.710365] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 3999230e-1d0e-405a-89ce-1135bcc77331 is going to be created. [ 806.749650] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.749990] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.750206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.750548] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.751082] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.752334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.338186] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 807.339403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.339691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.339947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.340186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.340344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.340422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.340593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.340690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.340796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.340893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.525846] env[65455]: INFO networking_nsxv3.common.synchronization [req-80a379fb-d6d1-46e4-83ec-e6d9d49bd9be req-624408af-56bd-4ec2-8388-f5df7df7bfdb service nova] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_rules [ 807.525975] env[65455]: INFO networking_nsxv3.common.synchronization [req-80a379fb-d6d1-46e4-83ec-e6d9d49bd9be req-624408af-56bd-4ec2-8388-f5df7df7bfdb service nova] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 807.526099] env[65455]: INFO networking_nsxv3.common.synchronization [req-80a379fb-d6d1-46e4-83ec-e6d9d49bd9be req-624408af-56bd-4ec2-8388-f5df7df7bfdb service nova] Enqueued Resource ID: 3999230e-1d0e-405a-89ce-1135bcc77331 with Priority: HIGHEST for action port [ 807.526761] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_rules [ 807.526917] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 807.528159] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3999230e-1d0e-405a-89ce-1135bcc77331 with Priority: HIGHEST for action port [ 807.529314] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.529449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.529521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.529796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.529898] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.530819] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.530934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.531019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.531188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.531342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.531490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.531547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.531682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.531767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.531857] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.532854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3999230e-1d0e-405a-89ce-1135bcc77331 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.534841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.534841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.534841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.534841] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3999230e-1d0e-405a-89ce-1135bcc77331',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.664919] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: SUCCESS [ 807.665136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.844023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.844023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.844023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.844548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.844548] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.844548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.844548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.844695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.844695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.844752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.844896] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.845023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.845055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.845197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.845394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.845471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.845581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.845702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.845785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.847129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.847129] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.854967] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c in Status: SUCCESS [ 807.854967] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bcfe12f-28f7-472c-8e5a-1f4d45ae689c deletion is rescheduled due to dependency. [ 807.854967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bcfe12f-28f7-472c-8e5a-1f4d45ae689c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.035241] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.039468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.039468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3999230e-1d0e-405a-89ce-1135bcc77331 with status ACTIVE [ 808.039468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.039468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.039468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.039468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.039990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.039990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.039990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.039990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.040254] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3999230e-1d0e-405a-89ce-1135bcc77331 is going to be updated. [ 808.167343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.167475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.167582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.167790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.167972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.168084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3999230e-1d0e-405a-89ce-1135bcc77331" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.189402] env[65455]: INFO networking_nsxv3.common.synchronization [req-c31c6276-3316-4144-8d74-77cbb781c5b4 req-17673491-c27d-4efe-b4f4-0d1b6a07de62 tempest-ServersV294TestFqdnHostnames-2000943012 tempest-ServersV294TestFqdnHostnames-2000943012-project-member] Enqueued Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 808.189960] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38ce0832-87af-446e-9ffb-4cf08e497970 with Priority: HIGHEST for action security_group_members [ 808.190306] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-38ce0832-87af-446e-9ffb-4cf08e497970 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.190426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.190492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.190706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.190871] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.190971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.191075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.191241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.191397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.191501] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38ce0832-87af-446e-9ffb-4cf08e497970',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.354835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de94ae8c-64b4-4119-bf51-89a5595f402a: rpc.has_security_group_logging(os_id): False [ 808.380194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.380442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.380611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.380994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.381214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.381636] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.381815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.381944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.383194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.383194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.383459] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.383722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.383778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.384460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.384460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.384569] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.384774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.385449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.385449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.385449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.385590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be created. [ 808.484053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.484276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.484418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.484753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.484987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.500959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 808.544159] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.694573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.694755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.694830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.695065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.717694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.718099] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.718241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.718241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.718423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.718534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.718600] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 is going to be updated. [ 808.786623] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.786623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.786623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.786813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.786949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.802680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: IN_PROGRESS for 2s [ 809.046787] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.047150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.047209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.047526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.047662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.047835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 is going to be created. [ 809.087626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.088053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.088053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.088402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.088659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.102100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: UNINITIALIZED for 2s [ 809.770280] env[65455]: INFO networking_nsxv3.common.synchronization [req-e0878868-0efa-4f35-abec-611938545cb5 req-effc324f-5701-4c58-9862-b3cad4387871 tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 809.770851] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 809.778039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.778169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.778210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.778479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.778597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.778697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.778761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.778908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.778994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.779123] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.074967] env[65455]: INFO networking_nsxv3.common.synchronization [req-e90f2fea-0d30-46e0-abcf-704a052b55ab req-4cb16e7c-d88e-4455-854d-4fa15d25741f tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 810.075534] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 810.075839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.075961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.076082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.076286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.076445] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.076572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.076636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.076791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.076872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.076963] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.282546] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.447318] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.447541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.447667] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.447926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.448277] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.448432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.448543] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.448816] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.448975] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.449200] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.449309] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.449411] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.449512] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.449614] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.449714] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.449838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.471212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.471212] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.471212] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.471212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.471212] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-a86abf1d-4477-4b73-8001-50625208305a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.471212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.471532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.471831] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.472028] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a86abf1d-4477-4b73-8001-50625208305a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.515595] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 810.515861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.579916] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.579916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.579916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.579916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.579916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.580204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.580204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.580279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.582342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.582342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.582342] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 810.615804] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.615804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.615804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.615804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.615804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.627031] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 810.788672] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.813406] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38ce0832-87af-446e-9ffb-4cf08e497970 in Status: SUCCESS [ 810.813625] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38ce0832-87af-446e-9ffb-4cf08e497970 deletion is rescheduled due to dependency. [ 810.813744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38ce0832-87af-446e-9ffb-4cf08e497970" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.975411] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.975634] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.975754] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.976051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.976201] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.976412] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port a86abf1d-4477-4b73-8001-50625208305a not found, creating... [ 810.976656] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.976862] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.977063] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.977311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.977461] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.977791] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.978018] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.978142] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.978372] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.978504] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.978661] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: a86abf1d-4477-4b73-8001-50625208305a is going to be created. [ 810.999524] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.999760] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.999929] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.000249] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.000478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.000734] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.114968] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: SUCCESS [ 811.115390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.115390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.115635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.115834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.115973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.116029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.116315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.116400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.116569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.116683] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.292353] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.292353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.292353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.294395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.294664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.294664] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 811.327254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.332237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.332237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.332237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.332237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.341663] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 811.619539] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.619752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.619885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.620211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.620463] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.620603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.620679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.620897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.621031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.621399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.621399] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.621583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.621583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.621718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.621891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.622023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.622194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.622349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.622457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.622605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.622782] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.755951] env[65455]: INFO networking_nsxv3.common.synchronization [req-e90f2fea-0d30-46e0-abcf-704a052b55ab req-6889370c-dea8-4768-9db5-74bf276fb8dc service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 811.756171] env[65455]: INFO networking_nsxv3.common.synchronization [req-e90f2fea-0d30-46e0-abcf-704a052b55ab req-6889370c-dea8-4768-9db5-74bf276fb8dc service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 811.756360] env[65455]: INFO networking_nsxv3.common.synchronization [req-e90f2fea-0d30-46e0-abcf-704a052b55ab req-6889370c-dea8-4768-9db5-74bf276fb8dc service nova] Enqueued Resource ID: a86abf1d-4477-4b73-8001-50625208305a with Priority: HIGHEST for action port [ 811.757345] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 811.757562] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 811.757783] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86abf1d-4477-4b73-8001-50625208305a with Priority: HIGHEST for action port [ 811.758488] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.758488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.758488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.758488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.758790] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.760957] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.760957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.761494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a86abf1d-4477-4b73-8001-50625208305a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.761494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.761707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.761852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.762009] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a86abf1d-4477-4b73-8001-50625208305a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.125551] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 729b41b0-b42f-49a0-b406-fc5850b09cf6: rpc.has_security_group_logging(os_id): False [ 812.148026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.148026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.148026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.148026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.148026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.150040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.150040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.150040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.150040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.150526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.150526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.150655] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.150750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.150809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.150946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.151031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.151114] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 is going to be created. [ 812.213709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.213879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.213949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.214148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.215434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.229602] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: IN_PROGRESS for 2s [ 812.261479] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.261735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.266254] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a86abf1d-4477-4b73-8001-50625208305a with status ACTIVE [ 812.266448] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.266624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.266673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.266915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.266996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.269560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.269560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.269560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.269560] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a86abf1d-4477-4b73-8001-50625208305a is going to be updated. [ 812.322431] env[65455]: INFO networking_nsxv3.common.synchronization [req-842cf95e-3d19-4aa1-a4db-cef4460ff80f req-7a192fe5-dc18-43ca-8411-31ba3b5cc158 tempest-InstanceActionsNegativeTestJSON-1969905280 tempest-InstanceActionsNegativeTestJSON-1969905280-project-member] Enqueued Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 812.323187] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 812.323479] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.323608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.323744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.324429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.324429] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.324429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.324429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.324622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.324654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.324759] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.331590] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.332621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.333140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.334172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.334172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.334172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a86abf1d-4477-4b73-8001-50625208305a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.638910] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 812.639122] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 deletion is rescheduled due to dependency. [ 812.639288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.639466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.639774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.639897] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.640122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.640122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.640768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.640768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.640768] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.767022] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-965 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.767022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-965" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.767022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-965" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.767022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-965" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.767022] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.767380] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.767599] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.767998] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.768256] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.768673] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.768976] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.769199] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.771056] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.771056] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 812.771056] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.771056] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.789988] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.789988] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 812.789988] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.790220] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-965" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.790335] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-c172daad-c23d-4520-bbbe-92596ea2cfb6 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.790532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.790658] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.790982] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.791128] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c172daad-c23d-4520-bbbe-92596ea2cfb6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.827104] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.827298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.827402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.827646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.827743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.827940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.828051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.828409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.828409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.828409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.828409] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa747c9-bcaa-4016-b259-ce693108d0ee already deleted. [ 812.828557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.143716] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.296276] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.296276] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.296526] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.296725] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.296884] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.297014] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port c172daad-c23d-4520-bbbe-92596ea2cfb6 not found, creating... [ 813.297298] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.297495] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.297652] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.297905] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.298063] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.298397] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.298559] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.298737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.299020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.299161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.299304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: c172daad-c23d-4520-bbbe-92596ea2cfb6 is going to be created. [ 813.327160] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.327423] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.327573] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.327879] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.328156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.328422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.355340] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 813.355657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.646704] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.093803] env[65455]: INFO networking_nsxv3.common.synchronization [req-842cf95e-3d19-4aa1-a4db-cef4460ff80f req-96cb32be-13af-46c0-b44b-5572b1b61b4b service nova] Enqueued Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_rules [ 814.093803] env[65455]: INFO networking_nsxv3.common.synchronization [req-842cf95e-3d19-4aa1-a4db-cef4460ff80f req-96cb32be-13af-46c0-b44b-5572b1b61b4b service nova] Enqueued Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 814.093975] env[65455]: INFO networking_nsxv3.common.synchronization [req-842cf95e-3d19-4aa1-a4db-cef4460ff80f req-96cb32be-13af-46c0-b44b-5572b1b61b4b service nova] Enqueued Resource ID: c172daad-c23d-4520-bbbe-92596ea2cfb6 with Priority: HIGHEST for action port [ 814.094475] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_rules [ 814.094643] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 814.094783] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c172daad-c23d-4520-bbbe-92596ea2cfb6 with Priority: HIGHEST for action port [ 814.095682] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.095682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.095682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.096073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.096073] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.097074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.097561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.097561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.097561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.097720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.097768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.097800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.098135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.098135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.098135] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.099117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c172daad-c23d-4520-bbbe-92596ea2cfb6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.099501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.099501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.099501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.099501] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c172daad-c23d-4520-bbbe-92596ea2cfb6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.148846] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.149170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.149214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.149471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.149764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.149764] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 814.198009] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.198009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.198009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.198009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.198009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.208098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 814.261571] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: SUCCESS [ 814.261913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.601967] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.602691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.602691] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.603950] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c172daad-c23d-4520-bbbe-92596ea2cfb6 with status ACTIVE [ 814.604095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.604202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.604793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.604793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.604860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.607160] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.607160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.607160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.607160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.607160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.607618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.607792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.607836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.608368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.608368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.608368] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c172daad-c23d-4520-bbbe-92596ea2cfb6 is going to be updated. [ 814.613321] env[65455]: INFO networking_nsxv3.common.synchronization [req-e4ba84a8-420f-486c-8779-f401c4631436 req-5fd1c15d-5756-4ab0-8137-49a1b0484fe4 tempest-ServerDiagnosticsTest-1349326979 tempest-ServerDiagnosticsTest-1349326979-project-member] Enqueued Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 814.614403] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed with Priority: HIGHEST for action security_group_members [ 814.614403] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.614403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.614403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.615605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.615605] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.615605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.615605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.615605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.615605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.615605] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d70687e5-a5c2-4fcd-8aab-9c7e15c186ed',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.640028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.640028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.640028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.640028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.640028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.640028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c172daad-c23d-4520-bbbe-92596ea2cfb6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.110625] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.120951] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.121618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.123565] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.123565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.123565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed is going to be updated. [ 815.159913] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.160222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.160277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.160660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.160841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.176673] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: IN_PROGRESS for 2s [ 815.617021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.617021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.617649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.617649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.617649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.617649] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa747c9-bcaa-4016-b259-ce693108d0ee is going to be created. [ 815.648832] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.648832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.649213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.649291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.649487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.662654] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: UNINITIALIZED for 2s [ 816.223247] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 4s [ 817.194371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed in Status: SUCCESS [ 817.194371] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d70687e5-a5c2-4fcd-8aab-9c7e15c186ed deletion is rescheduled due to dependency. [ 817.194371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d70687e5-a5c2-4fcd-8aab-9c7e15c186ed" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.454525] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3750fd3-2f52-45b7-ad38-c9d668ba3092 req-65cae59d-ef2f-462a-b815-c8c573d26400 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 817.455274] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 817.455641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.455772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.455839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.456075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.456249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.456346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.456395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.456585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.456669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.456761] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.676241] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: SUCCESS [ 817.676535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.677593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.678093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.678347] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.678669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.678669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.678873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.678977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.679498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.679603] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.788793] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.788992] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.789121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.789379] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.789632] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.789783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.789895] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.790118] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.790255] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.790451] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.790558] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.790732] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.790861] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.791047] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 817.791166] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.791527] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.814146] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.814342] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 817.814536] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.814759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.815196] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-6b36950b-48ef-40b2-961e-2ba9b0cd3959 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.815399] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.815548] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.815835] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.815974] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b36950b-48ef-40b2-961e-2ba9b0cd3959',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.959346] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.184142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.184142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.184142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.184142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.185053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.185053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.185351] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.234561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 818.234764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.234909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.235155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.235345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.235461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.235526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.235685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.235789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.235912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.235998] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.319706] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.319924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.319971] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.320321] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.320549] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.320738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 6b36950b-48ef-40b2-961e-2ba9b0cd3959 not found, creating... [ 818.321461] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.321667] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.321787] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.322080] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.322245] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.322533] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.322726] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.322860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.323080] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.323215] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.323348] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 6b36950b-48ef-40b2-961e-2ba9b0cd3959 is going to be created. [ 818.347283] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.347488] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.347709] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.347986] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.348244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.348481] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.465205] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.687212] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for daa747c9-bcaa-4016-b259-ce693108d0ee: rpc.has_security_group_logging(os_id): False [ 818.714115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.714356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.714415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.714723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.714868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.715105] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.715240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.715309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.715596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.715690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.716035] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.716162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.716162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.716315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.716393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.716692] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.716793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.716880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.717074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.717158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.717247] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: daa747c9-bcaa-4016-b259-ce693108d0ee is going to be created. [ 818.738413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.738634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.738691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.738978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.739207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.739318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.739386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.739584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.739705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.739827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.740037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.740143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.740206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.740357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.740510] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.740645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.740729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.740916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.741020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.741111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.741201] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.785194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.785409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.785409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.785621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.785816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.798396] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: IN_PROGRESS for 2s [ 818.967737] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.967967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.968079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.968329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.968423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.968527] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be updated. [ 819.000893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.001063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.001120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.001336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.001481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.011945] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 819.076405] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3750fd3-2f52-45b7-ad38-c9d668ba3092 req-c8580838-237c-4ca4-b079-7ebb6b4baa3c service nova] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_rules [ 819.076661] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3750fd3-2f52-45b7-ad38-c9d668ba3092 req-c8580838-237c-4ca4-b079-7ebb6b4baa3c service nova] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 819.076806] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3750fd3-2f52-45b7-ad38-c9d668ba3092 req-c8580838-237c-4ca4-b079-7ebb6b4baa3c service nova] Enqueued Resource ID: 6b36950b-48ef-40b2-961e-2ba9b0cd3959 with Priority: HIGHEST for action port [ 819.077332] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_rules [ 819.077468] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 819.077567] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b36950b-48ef-40b2-961e-2ba9b0cd3959 with Priority: HIGHEST for action port [ 819.077860] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.077957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.078070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.078297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.078371] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.079659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.079871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.080104] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b36950b-48ef-40b2-961e-2ba9b0cd3959 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.080212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.080275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.080450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.080526] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b36950b-48ef-40b2-961e-2ba9b0cd3959',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.244229] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5: rpc.has_security_group_logging(os_id): False [ 819.270872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.271075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.271143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.271374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.271465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.271738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.271854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.271928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.272112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.272192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.272420] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.272518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.272596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.272748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.272837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.273035] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.273134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.273243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.273351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.273429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.273528] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 819.369580] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.369842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.369842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.370031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.370162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.386187] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 819.580985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.581548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.582454] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b36950b-48ef-40b2-961e-2ba9b0cd3959 with status ACTIVE [ 819.582707] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.582836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.582904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.583151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.583273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.583453] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.583557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.583603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.583728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.583845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.584016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.584159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.584243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.584409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.584471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.584563] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b36950b-48ef-40b2-961e-2ba9b0cd3959 is going to be updated. [ 819.611348] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.611595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.611595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.611747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.611889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.612067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b36950b-48ef-40b2-961e-2ba9b0cd3959" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.995271] env[65455]: INFO networking_nsxv3.common.synchronization [req-0b3628d1-2f4d-4fb6-b63b-fd58e95a51eb req-dffeb703-9d09-4fa7-8490-19fe0a118a1b tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 819.995848] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 819.996315] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.996439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.996506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.996923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.996923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.997073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.997073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.997218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.997303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.997398] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.327067] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.327423] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.327532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.327903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.328290] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.328517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.328694] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.329016] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.329225] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.329509] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.332065] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.332065] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.332065] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.332065] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.332065] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.332065] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.353838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.354108] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.354261] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.354454] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-522" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.354913] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-46877f3c-88c5-453e-897c-5c4698b6a499 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.355150] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.355270] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.355728] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.355892] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46877f3c-88c5-453e-897c-5c4698b6a499',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.501602] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.822350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: SUCCESS [ 820.822719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.859176] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.859417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.859555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.859838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.859985] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.860150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 46877f3c-88c5-453e-897c-5c4698b6a499 not found, creating... [ 820.860415] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.860570] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.860685] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.860914] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.861056] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.861373] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.862134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.862134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.862134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.862134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.862324] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 46877f3c-88c5-453e-897c-5c4698b6a499 is going to be created. [ 820.888064] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.888329] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.888385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.888695] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.889134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.889134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.003608] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.025351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 821.025605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.025889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.026389] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.026550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.026695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.026924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.027076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.027215] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.248978] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.249280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.249358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.249591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.249700] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.401781] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 821.402067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.506165] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.506377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.506470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.506764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.506885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.506996] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 821.529869] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.551997] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.552254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.552368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.552700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.552906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.565391] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 821.623418] env[65455]: INFO networking_nsxv3.common.synchronization [req-0b3628d1-2f4d-4fb6-b63b-fd58e95a51eb req-511ce10a-7dab-4876-a61f-efb03cc63384 service nova] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 821.623688] env[65455]: INFO networking_nsxv3.common.synchronization [req-0b3628d1-2f4d-4fb6-b63b-fd58e95a51eb req-511ce10a-7dab-4876-a61f-efb03cc63384 service nova] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 821.623864] env[65455]: INFO networking_nsxv3.common.synchronization [req-0b3628d1-2f4d-4fb6-b63b-fd58e95a51eb req-511ce10a-7dab-4876-a61f-efb03cc63384 service nova] Enqueued Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 821.624602] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 821.624805] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 821.624962] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 821.625542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.625542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.626015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.626015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.626015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.627200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.627641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.627641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-46877f3c-88c5-453e-897c-5c4698b6a499 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.627786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.627911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.628172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.628243] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46877f3c-88c5-453e-897c-5c4698b6a499',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.752178] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.034286] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.130260] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.130480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.130635] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46877f3c-88c5-453e-897c-5c4698b6a499 with status ACTIVE [ 822.130831] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.130960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.131058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.131376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.131431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.131614] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.131739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.131812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.132021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.132143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.132433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.132946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.132946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.132946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.132946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.132946] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46877f3c-88c5-453e-897c-5c4698b6a499 is going to be updated. [ 822.156038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.156038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.156038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.156038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.156038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.156446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.256666] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.537595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.537868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.537982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.538308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.538454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.538572] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be updated. [ 822.571318] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.571558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.571558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.571825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.571970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.582775] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 822.760114] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 822.760329] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 823.579328] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 823.579758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.579837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.580135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.580382] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.580554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.580649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.580827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.580913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.581016] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.630577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.630803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.630803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.631042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.788202] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 823.789148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.790083] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 823.839472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.839681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.839681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.839885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.846026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.846633] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 823.846731] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 823.846826] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 823.887724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.887894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.887961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.888192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.889542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.889755] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 823.961497] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.961736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.961736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.961921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.962159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.962375] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 824.029208] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.029470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.029470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.029701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.029927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.030192] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:38. [ 824.030293] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2d88d984-b158-405e-922b-bf70bddac6ef', '6c141c29-42c3-41f9-b7dc-ffdc17a6c975', '6fe6dc0e-8a36-4463-aa2a-12b94566760c', '070a53e6-caa7-4afa-8d02-177f2d45739a', 'ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af', 'c9b30223-71ca-4cf7-ab29-768aa4761f18', '1cb582a8-be40-4b11-ac01-813b4c480718', 'fadf75a5-9161-4bdb-8e45-26618ca6c5ea', 'ea5c289d-af02-4d2b-a1c6-0622c1d1d251', '42a8d0a2-99ce-4c84-bb03-a9bf686e0924', '4e9b38b3-5f77-4dd5-8cb8-d5807066b26a', '729b41b0-b42f-49a0-b406-fc5850b09cf6', '638a5dec-549c-4c78-9abf-ae2d5f9d5265', '9d1eda5c-438c-423f-9e82-2cec12b4ecd8', '26ed7fa4-c041-48e3-8d4c-2e341fddd4b5', '45b5142c-4bc9-41fd-a039-af08feb308fd', 'a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17', '57ec5c2d-0701-464f-b730-022584dac61b', '0cfb754e-de2d-4baa-bb6c-0888418311d4', '1a002e78-68ea-47cf-a3fa-5807e1bee919', 'd2645787-f0c6-445b-afb0-d7c9acc45e6c', '5d835a6b-ad66-42cb-9c87-a0b00ea650f8', '96905b57-3285-43c8-99f7-2f66d28aafa1', '0a198777-edb2-486c-96fc-27aa5daf59ad', 'c8ac4b88-966c-4479-95d3-80b154d92475', 'f8950d72-cdfa-4b89-babf-49c50bce2b96', '2bcfe12f-28f7-472c-8e5a-1f4d45ae689c', 'e805e5ac-07cc-4195-97d9-60139abf3cc5', '10c4ff11-5e8b-4540-903a-abb548417d57', '50ff894b-9924-4f71-b210-20859560462d', 'a4a6023d-5c33-4db0-b5c2-37c37091322f', 'de94ae8c-64b4-4119-bf51-89a5595f402a', 'daa747c9-bcaa-4016-b259-ce693108d0ee', '4e9d5580-b38c-4840-86f0-a6cc8d6dbd99', 'd70687e5-a5c2-4fcd-8aab-9c7e15c186ed', '38ce0832-87af-446e-9ffb-4cf08e497970', 'a0ddf7c7-f7d9-457a-834f-979355b01964', '07680d19-56f1-4d34-ab9f-26b0ad63d370'} {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.030400] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 824.049672] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.049898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.049898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.050131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.050212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.050325] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 824.050394] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.050462] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 824.083462] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.130214] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.130545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.130545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.130680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.131409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.131639] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 824.131718] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 824.131820] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 824.131903] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 824.132016] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/38 resources of Type:Security Group Rules [ 824.132016] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 824.132188] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGH for action security_group_rules [ 824.132188] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGH for action security_group_rules [ 824.132294] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGH for action security_group_rules [ 824.132294] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGH for action security_group_rules [ 824.132359] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGH for action security_group_rules [ 824.132399] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGH for action security_group_rules [ 824.132430] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGH for action security_group_rules [ 824.132528] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGH for action security_group_rules [ 824.132528] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGH for action security_group_rules [ 824.132682] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGH for action security_group_rules [ 824.132682] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGH for action security_group_rules [ 824.132820] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGH for action security_group_rules [ 824.132820] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGH for action security_group_rules [ 824.132976] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGH for action security_group_rules [ 824.132976] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGH for action security_group_rules [ 824.132976] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGH for action security_group_rules [ 824.133189] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGH for action security_group_rules [ 824.133189] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGH for action security_group_rules [ 824.133189] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGH for action security_group_rules [ 824.133305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.586546] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.593939] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 824.594221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.594396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.594857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.594857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.594950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.595052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.595242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.597467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.597467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.597467] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.702266] env[65455]: INFO networking_nsxv3.common.synchronization [req-88d30e3c-d342-4e6c-a4d0-cef34621d5a1 req-62df259e-8349-42a0-8e5d-b3e89a1a3b38 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 824.702970] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 824.703183] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 824.703323] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGH for action security_group_rules [ 824.703483] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb582a8-be40-4b11-ac01-813b4c480718 with Priority: HIGH for action security_group_rules [ 824.703575] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGH for action security_group_rules [ 824.703709] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 with Priority: HIGH for action security_group_rules [ 824.703827] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGH for action security_group_rules [ 824.703968] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ec5c2d-0701-464f-b730-022584dac61b with Priority: HIGH for action security_group_rules [ 824.704120] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 with Priority: HIGH for action security_group_rules [ 824.704277] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 with Priority: HIGH for action security_group_rules [ 824.704759] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGH for action security_group_rules [ 824.704906] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 with Priority: HIGH for action security_group_rules [ 824.705090] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGH for action security_group_rules [ 824.705259] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a with Priority: HIGH for action security_group_rules [ 824.705320] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGH for action security_group_rules [ 824.705410] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGH for action security_group_rules [ 824.705517] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 with Priority: HIGH for action security_group_rules [ 824.705654] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGH for action security_group_rules [ 824.705797] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af with Priority: HIGH for action security_group_rules [ 824.705936] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 with Priority: HIGH for action security_group_rules [ 824.706063] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070a53e6-caa7-4afa-8d02-177f2d45739a with Priority: HIGH for action security_group_rules [ 824.706583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.706777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.706884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.707235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.707457] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.707722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.707722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.708150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.708150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.708150] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.709323] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.709478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.709578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.709809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.709956] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.712381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.712636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.712636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.712889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.713052] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.714208] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1cb582a8-be40-4b11-ac01-813b4c480718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.714346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.714423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.714665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.714761] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1cb582a8-be40-4b11-ac01-813b4c480718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.716446] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.716692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.716692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.716875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.716945] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.718540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a002e78-68ea-47cf-a3fa-5807e1bee919 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.718540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.718540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.718803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.718882] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a002e78-68ea-47cf-a3fa-5807e1bee919',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.720164] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.720351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.720451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.720710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.721197] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.722843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57ec5c2d-0701-464f-b730-022584dac61b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.723037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.723132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.723294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.723383] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57ec5c2d-0701-464f-b730-022584dac61b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.724673] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.724830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.724911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.725168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.725276] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.725686] env[65455]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 824.726684] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.726859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.726971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.727267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.727372] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d1eda5c-438c-423f-9e82-2cec12b4ecd8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.729075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.729350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.729350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.729570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.729570] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.730751] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.730904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.730991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.731278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.731415] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('638a5dec-549c-4c78-9abf-ae2d5f9d5265',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.732599] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.732739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.732873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.733193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.733304] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.734654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.734867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.734867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735162] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9b38b3-5f77-4dd5-8cb8-d5807066b26a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.736442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.736568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.736659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.736853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.736956] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.738150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.738275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.738275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.739461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.739461] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.741257] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9b30223-71ca-4cf7-ab29-768aa4761f18 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.741380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.741446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.741635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.741801] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9b30223-71ca-4cf7-ab29-768aa4761f18',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.742679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.743037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.743037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.743251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.743300] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.744210] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.744313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.744407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.744546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744695] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.744876] env[65455]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 824.745701] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.745870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.745989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.746182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.746264] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6c141c29-42c3-41f9-b7dc-ffdc17a6c975',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.747150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070a53e6-caa7-4afa-8d02-177f2d45739a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.747275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.747333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.747508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.747573] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070a53e6-caa7-4afa-8d02-177f2d45739a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.751194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.751621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.751621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.751773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.752142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.752142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.752142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.752348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.752348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.752494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.752494] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.754385] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.754893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.754893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.754893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.754893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.755192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.755192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.755301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.755911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.755911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.755911] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.756895] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.756992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.757990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.757990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.757990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.757990] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.757990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.757990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.758483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.758483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.758483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 already deleted. [ 824.758483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.091059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.091059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.091059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.091059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.091059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.091059] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 825.096061] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.096349] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.096549] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.096950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.097312] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.097547] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.097738] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.098045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.098381] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.098562] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.098742] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.098936] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.099482] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.099482] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.099482] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.099754] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.101596] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.101756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.101875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.102097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.102311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.102461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.102581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.102781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.102912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.103066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.103278] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.103429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.103536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.103732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.103923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.104088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.104197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.104391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.104512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.104644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.104791] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.125735] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.125948] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.126077] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.126262] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.126673] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-37f0778f-d80a-4557-addc-d81ed86a82f5 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.126866] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.126986] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.127311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.127446] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f0778f-d80a-4557-addc-d81ed86a82f5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.129841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.130043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.130117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.130368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.130556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.141188] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 825.262244] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.262447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.262516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.262814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.262991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.263108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.263171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.263350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.263481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.263579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.263743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.263915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.264039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.264220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.264367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.264479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.264537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.264711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.264783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.264865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.264955] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.266074] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.297734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.297962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.297962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.298187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.298346] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.298477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.298525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.298690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.298799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.298881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.299069] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.303792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.303937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.304039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.304258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.304438] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.304613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.304678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.304855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.304966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.305066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.305158] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.306558] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.306706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.306774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.306940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.307160] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.307344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.307344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.307509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.307599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.307718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.307809] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.311543] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.311693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.312324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.312324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.312324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.312324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.312324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.312526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.312572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.312683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.312772] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.315248] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.315428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.315523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.315745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.315915] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.316032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.316115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.316284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.316421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.316491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.316652] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.320950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.321152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.321241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.321622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.321755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.321905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.322021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.322200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.322318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.322510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.322628] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.400646] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.400865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.400865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.401148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.403811] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.403955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.404797] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.404912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.405677] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.405807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.406532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.406658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.407409] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.407497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.408216] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.408306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.409057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.409168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.409873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.409973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.411209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.411317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.412066] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.412186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.412769] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 825.413233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.413324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.430900] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 825.431573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.431764] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9b30223-71ca-4cf7-ab29-768aa4761f18 is going to be deleted. [ 825.432959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.433244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.454818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.455023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d1eda5c-438c-423f-9e82-2cec12b4ecd8 is going to be deleted. [ 825.456195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.456417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.481439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.481617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 638a5dec-549c-4c78-9abf-ae2d5f9d5265 is going to be deleted. [ 825.482660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.482948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.505940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.506206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.510367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.510542] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1cb582a8-be40-4b11-ac01-813b4c480718 is going to be deleted. [ 825.511533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.511756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.518127] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.518332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.532578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.532773] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9b38b3-5f77-4dd5-8cb8-d5807066b26a is going to be deleted. [ 825.534071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.534413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.563739] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.563952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.591626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.592116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.607673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.607912] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57ec5c2d-0701-464f-b730-022584dac61b is going to be deleted. [ 825.609032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10c4ff11-5e8b-4540-903a-abb548417d57: rpc.has_security_group_logging(os_id): False [ 825.609983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.610243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.630554] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.630796] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.630880] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.631215] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.631367] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.631523] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 37f0778f-d80a-4557-addc-d81ed86a82f5 not found, creating... [ 825.631783] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.631948] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.632077] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.632310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.632446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.632726] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.632879] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.632993] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.633242] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.633372] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.633511] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 37f0778f-d80a-4557-addc-d81ed86a82f5 is going to be created. [ 825.649601] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.649890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.650969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.651093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.661678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.661888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be deleted. [ 825.662874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.663109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.696370] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.696861] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.696935] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.697213] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.697448] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.697793] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.700802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.700985] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a002e78-68ea-47cf-a3fa-5807e1bee919 is going to be deleted. [ 825.702148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.702446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.738501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.738682] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af is going to be deleted. [ 825.739989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.740367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.768745] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 825.770304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 825.802315] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.828157] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.828414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.828414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.828671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.828859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.829041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.829214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.829399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.829491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.829591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.829787] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.829929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.829970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.830118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.830259] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.830367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.830426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.830584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.830671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.830754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.830845] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.831905] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.832957] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.834018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.834144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.834207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.834403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.834735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.834735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.834735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.834922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.834986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.835136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.835259] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.835358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.835490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.835669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.835813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.835904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.835960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.836126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.836630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.836747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.836846] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.838221] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.838358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.838407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.838626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.838792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.838962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.839048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.839223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.839321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.839407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.839577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.839680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.839732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.839892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.840045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.840174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.840240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.840403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.840481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.840562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.840663] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.847834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.847980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.850298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.850443] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6c141c29-42c3-41f9-b7dc-ffdc17a6c975 is going to be deleted. [ 825.852133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.852384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.892561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.892798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.895435] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.895590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.900155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.900305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.911231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.911474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.949434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.950736] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17 is going to be deleted. [ 825.952262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.952605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.971644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.971933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.011246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.011449] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070a53e6-caa7-4afa-8d02-177f2d45739a is going to be deleted. [ 826.012707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.012978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.013114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.013248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9b30223-71ca-4cf7-ab29-768aa4761f18" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.013643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.013876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.013980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.014142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d1eda5c-438c-423f-9e82-2cec12b4ecd8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.014801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.014985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.015112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.015243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-638a5dec-549c-4c78-9abf-ae2d5f9d5265" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.015410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.015574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.015795] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.015927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1cb582a8-be40-4b11-ac01-813b4c480718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.016122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.016280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.043320] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.043542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.067026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.067542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.067700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.067777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.067990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.068082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.068302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.068400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.068455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.068604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.068721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.068934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.069045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.069045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.069179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.069251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.069345] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be updated. [ 826.070434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.070650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.070744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.070855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9b38b3-5f77-4dd5-8cb8-d5807066b26a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.070992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.071139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.071217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.071323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.071466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.071700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.071822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.071922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57ec5c2d-0701-464f-b730-022584dac61b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.072044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.072183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.135871] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.136144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.147857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.148043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.148043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.148172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.148352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.148438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.148537] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 826.149806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.149995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.214042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.214042] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.214042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.214042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.214383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.214383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.214576] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.214697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.214781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.214955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.215089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.215336] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.215428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.215504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.215685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.215793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.216043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 826.217372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.217550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.217773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.217773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6c141c29-42c3-41f9-b7dc-ffdc17a6c975" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.217918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a002e78-68ea-47cf-a3fa-5807e1bee919" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9388f77-c2d9-49e0-9dc8-ae29c2ed3e17" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.219514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.219612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.219718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ffbd8bd0-a9d9-47ed-8ae6-ab9e097272af" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.267933] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.267933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.267933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.268311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.268311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.268422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070a53e6-caa7-4afa-8d02-177f2d45739a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.305999] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fadf75a5-9161-4bdb-8e45-26618ca6c5ea: rpc.has_security_group_logging(os_id): False [ 826.334166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cfb754e-de2d-4baa-bb6c-0888418311d4: rpc.has_security_group_logging(os_id): False [ 826.340986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea5c289d-af02-4d2b-a1c6-0622c1d1d251: rpc.has_security_group_logging(os_id): False [ 826.342507] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45b5142c-4bc9-41fd-a039-af08feb308fd: rpc.has_security_group_logging(os_id): False [ 826.345324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.345526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.345526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.345757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.347740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.347906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.349858] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5: rpc.has_security_group_logging(os_id): False [ 826.351419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 729b41b0-b42f-49a0-b406-fc5850b09cf6: rpc.has_security_group_logging(os_id): False [ 826.398701] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.399083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.404521] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.404718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.406613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.406766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.410207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.410373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.411658] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.411780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.413788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.413995] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.414128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.414254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.414536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.414724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.414844] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 826.416494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.416799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.416983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.419410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.419653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.422554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.422696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.498797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.499990] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.500163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.500257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.500669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.500789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.500908] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be updated. [ 826.502620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.502866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.506082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.506199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.531637] env[65455]: INFO networking_nsxv3.common.synchronization [req-88d30e3c-d342-4e6c-a4d0-cef34621d5a1 req-4b480bfe-ea60-4573-9726-124b6775d0f7 service nova] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 826.531637] env[65455]: INFO networking_nsxv3.common.synchronization [req-88d30e3c-d342-4e6c-a4d0-cef34621d5a1 req-4b480bfe-ea60-4573-9726-124b6775d0f7 service nova] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 826.531829] env[65455]: INFO networking_nsxv3.common.synchronization [req-88d30e3c-d342-4e6c-a4d0-cef34621d5a1 req-4b480bfe-ea60-4573-9726-124b6775d0f7 service nova] Enqueued Resource ID: 37f0778f-d80a-4557-addc-d81ed86a82f5 with Priority: HIGHEST for action port [ 826.534599] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 826.534599] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_rules [ 826.534599] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 826.534599] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f0778f-d80a-4557-addc-d81ed86a82f5 with Priority: HIGHEST for action port [ 826.535026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.535026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.535205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.535506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.535506] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.538138] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.538138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.538306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.539452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.539452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.539452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.539452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.539452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.539452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.539794] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.541925] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-37f0778f-d80a-4557-addc-d81ed86a82f5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.542119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.542119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.542348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.542673] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f0778f-d80a-4557-addc-d81ed86a82f5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.582469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.582469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.582640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.582782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.586031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.586031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.586031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.586031] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 is going to be updated. [ 826.586884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.586884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.628518] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.629190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.654640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.655171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.655171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.655171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.655429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.655429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.655827] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.655941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.655996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.656209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.656347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.656588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.656694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.656854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.657047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.657258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.657418] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 826.659222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.659446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.710227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.710783] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.711048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.711308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.711630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.711788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.712097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.712417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.712591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.712946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.713247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.713499] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.713499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.713723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.713788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.713906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.714034] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 826.715480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.715722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.716355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.717210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.717503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.717767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.719891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.720219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.720387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.721805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.722047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.739539] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 826.741503] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 826.753635] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 826.808818] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.809066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.810478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.810691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.816550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.816777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.823821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.825172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.825172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.825172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.825545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.825716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.825909] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd is going to be updated. [ 826.827903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.828105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.828308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.830796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.830796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.830796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.832256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.832555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.832797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.876906] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: IN_PROGRESS for 2s [ 826.878495] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 826.879578] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: IN_PROGRESS for 2s [ 827.024949] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.025166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.025248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.025479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.025708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.044890] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.048899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.048899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.048899] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37f0778f-d80a-4557-addc-d81ed86a82f5 with status ACTIVE [ 827.048899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.048899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.048899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.048899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.049407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.049407] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.051052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.051052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.052093] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37f0778f-d80a-4557-addc-d81ed86a82f5 is going to be updated. [ 827.054150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 827.055679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.055965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.056089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.056401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.056660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.090181] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: IN_PROGRESS for 2s [ 827.108126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.108317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.108368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.108587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.109481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.109481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37f0778f-d80a-4557-addc-d81ed86a82f5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.169621] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 827.170873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.170873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.170873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.170873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.170873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.170873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.171278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.171278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.171278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.171380] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.549212] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.674142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.674503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.674503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.674642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.674817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.674921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.674988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.675160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.675245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.675333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.675479] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.675569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.675664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.675824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.675966] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.676091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.676201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.676354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.676461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.676567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.677456] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.053655] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.053854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.053923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.054221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.054336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.054522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 is going to be created. [ 828.087623] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.087869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.087869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.088316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.088316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.103155] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: UNINITIALIZED for 2s [ 828.183248] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 828.231466] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.231741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.231899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.232156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.305085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.305085] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.305337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.305337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.305471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.305557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.305803] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.305959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.306022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.306173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.306257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.306487] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.306662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.306730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.306912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.307038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.307109] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 828.568103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 828.568103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.583905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.583905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.584136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.584200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.584388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.600868] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 828.775486] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 828.775486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.779154] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 828.779154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.779887] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 828.779887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.893726] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: SUCCESS [ 828.893726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.895295] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: SUCCESS [ 828.895669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.899317] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 828.899582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.072461] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 829.072951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.107228] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: SUCCESS [ 829.108205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.617807] env[65455]: INFO networking_nsxv3.common.synchronization [req-294d2aa1-83aa-402d-bc89-eb1b0aa23ed6 req-2ba51199-bc7a-405f-a0c2-fa2280c3e88f tempest-ServerGroupTestJSON-1040491830 tempest-ServerGroupTestJSON-1040491830-project-member] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 829.619076] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGHEST for action security_group_members [ 829.619714] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.619714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.619714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.620041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.620634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.620634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.620634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.620634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.621091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.621091] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.123271] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: SUCCESS [ 830.123558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.123883] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.124026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.124092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.124304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.124400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.124566] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.124703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.124752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.124889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.124980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.125054] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 is going to be updated. [ 830.126320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.126320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.126401] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.126487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.126545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.126718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.126799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.126883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.126980] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.156794] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.159018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.159018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.159018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.159351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.172481] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: IN_PROGRESS for 2s [ 830.614388] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 830.614623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.629893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.133505] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a18e5b54-8a6d-4a7c-985e-7a6963e15109: rpc.has_security_group_logging(os_id): False [ 831.153980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.154184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.154253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.154455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.154569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.155158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.155158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.155158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.155343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.155343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.155461] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 is going to be created. [ 831.224542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.224718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.224792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.225076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.225279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.238520] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: IN_PROGRESS for 2s [ 831.536765] env[65455]: INFO networking_nsxv3.common.synchronization [req-843e8b13-126b-449f-8f71-59d3496f225f req-2df0b510-279d-40a4-b88b-3a845defe831 tempest-InstanceActionsNegativeTestJSON-1969905280 tempest-InstanceActionsNegativeTestJSON-1969905280-project-member] Enqueued Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 831.540289] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: daa747c9-bcaa-4016-b259-ce693108d0ee with Priority: HIGHEST for action security_group_members [ 831.540289] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-daa747c9-bcaa-4016-b259-ce693108d0ee taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.540289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.540289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.540289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.540289] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.540673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.540673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.540673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.540673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.540805] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('daa747c9-bcaa-4016-b259-ce693108d0ee',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.048395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.049502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.049502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.049502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.075121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.075499] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.075669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.075752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.075981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.076105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.076226] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa747c9-bcaa-4016-b259-ce693108d0ee is going to be updated. [ 832.112302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.112548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.112548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.112735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.112887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.123255] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: IN_PROGRESS for 2s [ 832.186521] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 in Status: SUCCESS [ 832.186849] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 deletion is rescheduled due to dependency. [ 832.186849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.564521] env[65455]: INFO networking_nsxv3.common.synchronization [req-dac1d9f6-2386-422b-8e96-a54eb66dbd0e req-38254dcf-bd55-4e31-8f26-2577dbd5a406 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 832.564521] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 832.565187] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.565579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.565668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.566367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.566367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.566367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.566367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.566638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.566752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.566870] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.072047] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.072239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.072239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.072856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.110898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.112031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.112031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.112031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.112031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.112031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.112031] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 833.160538] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.160822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.160891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.161211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.161419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.172670] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 833.253826] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: SUCCESS [ 833.254122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.135849] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: daa747c9-bcaa-4016-b259-ce693108d0ee in Status: SUCCESS [ 834.137518] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: daa747c9-bcaa-4016-b259-ce693108d0ee deletion is rescheduled due to dependency. [ 834.137742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-daa747c9-bcaa-4016-b259-ce693108d0ee" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.320285] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d59b5b84-94c9-4e40-8d44-54cff6c98c67 None None] Enqueued Resource ID: c8d05198-8059-4ee0-acfd-06dad2c40aa3 with Priority: HIGHEST for action port [ 834.320285] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8d05198-8059-4ee0-acfd-06dad2c40aa3 with Priority: HIGHEST for action port [ 834.320285] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8d05198-8059-4ee0-acfd-06dad2c40aa3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.320285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8d05198-8059-4ee0-acfd-06dad2c40aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.320285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8d05198-8059-4ee0-acfd-06dad2c40aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.320285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8d05198-8059-4ee0-acfd-06dad2c40aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.320285] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8d05198-8059-4ee0-acfd-06dad2c40aa3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.825418] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8d05198-8059-4ee0-acfd-06dad2c40aa3 [ 834.825716] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.825856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.825927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.826191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.826298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.826432] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8d05198-8059-4ee0-acfd-06dad2c40aa3 already deleted. [ 834.826529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8d05198-8059-4ee0-acfd-06dad2c40aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.185468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 835.185468] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 835.185468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.806840] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1a4369b5-220a-4340-a714-067bcd983a37 None None] Enqueued Resource ID: 66ed03ff-4973-41bc-959b-95af6c44e5f3 with Priority: HIGHEST for action port [ 835.807519] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ed03ff-4973-41bc-959b-95af6c44e5f3 with Priority: HIGHEST for action port [ 835.808100] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-66ed03ff-4973-41bc-959b-95af6c44e5f3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.808346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66ed03ff-4973-41bc-959b-95af6c44e5f3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.808420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66ed03ff-4973-41bc-959b-95af6c44e5f3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.808835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66ed03ff-4973-41bc-959b-95af6c44e5f3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.808835] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ed03ff-4973-41bc-959b-95af6c44e5f3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.312736] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66ed03ff-4973-41bc-959b-95af6c44e5f3 [ 836.313606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.313606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.313606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.313892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.313892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.313892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66ed03ff-4973-41bc-959b-95af6c44e5f3 already deleted. [ 836.314139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66ed03ff-4973-41bc-959b-95af6c44e5f3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.976183] env[65455]: INFO networking_nsxv3.common.synchronization [None req-91475487-bc63-49d1-a8af-0706b8a73796 None None] Enqueued Resource ID: a8018e04-03e6-4bbd-832a-28d3443ef050 with Priority: HIGHEST for action port [ 836.977596] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8018e04-03e6-4bbd-832a-28d3443ef050 with Priority: HIGHEST for action port [ 836.981063] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8018e04-03e6-4bbd-832a-28d3443ef050 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.981063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8018e04-03e6-4bbd-832a-28d3443ef050" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.981063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8018e04-03e6-4bbd-832a-28d3443ef050" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.981063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8018e04-03e6-4bbd-832a-28d3443ef050" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.981063] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8018e04-03e6-4bbd-832a-28d3443ef050',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.236589] env[65455]: INFO networking_nsxv3.common.synchronization [None req-4b1fa87a-bad9-4d9d-9a69-6ba244c49782 tempest-ServersTestManualDisk-393770702 tempest-ServersTestManualDisk-393770702-project-member] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 837.237279] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 837.237599] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.237744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.237820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.238623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.238782] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.432574] env[65455]: INFO networking_nsxv3.common.synchronization [None req-039a1fec-bd17-4896-893e-3e9a9b141e0e tempest-ServersTestManualDisk-393770702 tempest-ServersTestManualDisk-393770702-project-member] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 837.433269] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 837.433584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.433982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.483804] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8018e04-03e6-4bbd-832a-28d3443ef050 [ 837.483895] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.483958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.484045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.484265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.484350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.485090] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8018e04-03e6-4bbd-832a-28d3443ef050 already deleted. [ 837.485090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8018e04-03e6-4bbd-832a-28d3443ef050" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.765998] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.765998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.765998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.766365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.766796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.766796] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 already deleted. [ 837.767495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.767495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.768719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.768719] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.319793] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.319793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.319793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.320621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.320621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.320621] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 already deleted. [ 838.320621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.988476] env[65455]: INFO networking_nsxv3.common.synchronization [None req-86492f76-5071-455c-80d6-703986f7d3ba None None] Enqueued Resource ID: a8e978a6-7471-4ad6-a67c-b9c14de300db with Priority: HIGHEST for action port [ 838.989128] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e978a6-7471-4ad6-a67c-b9c14de300db with Priority: HIGHEST for action port [ 838.989443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8e978a6-7471-4ad6-a67c-b9c14de300db taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.989588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8e978a6-7471-4ad6-a67c-b9c14de300db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.989658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8e978a6-7471-4ad6-a67c-b9c14de300db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.991824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8e978a6-7471-4ad6-a67c-b9c14de300db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.991824] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e978a6-7471-4ad6-a67c-b9c14de300db',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.497317] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8e978a6-7471-4ad6-a67c-b9c14de300db [ 839.497596] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.498028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.498162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.498418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.498507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.498553] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8e978a6-7471-4ad6-a67c-b9c14de300db already deleted. [ 839.498631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8e978a6-7471-4ad6-a67c-b9c14de300db" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.068512] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 840.068750] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 840.069563] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 840.069681] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 840.070372] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.070372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.070372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.070649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.070649] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.070649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.070831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.070885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.070950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.071050] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.072989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.072989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.072989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.072989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.073733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.073733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.073733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.073733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.073733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.073733] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.132969] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_rules [ 840.133512] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 840.133604] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 840.133895] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 840.135049] env[65455]: INFO networking_nsxv3.common.synchronization [req-67e95888-f00f-41a1-97bf-c958e9bfba34 req-92fb5640-e44b-46ab-a888-97c58dab4c95 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 840.135358] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_rules [ 840.135767] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 840.136286] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 840.136286] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 840.136286] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 840.136553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.136651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.136651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.137379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.138281] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.141546] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.141546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.141546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.141546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.141821] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.145318] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-46877f3c-88c5-453e-897c-5c4698b6a499 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.145458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.145527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.145743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.145827] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46877f3c-88c5-453e-897c-5c4698b6a499',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.146784] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.146892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.147163] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.147266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.573879] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.576846] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.651891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.651891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.651891] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46877f3c-88c5-453e-897c-5c4698b6a499 with status ACTIVE [ 840.651891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.651891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.651891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.652632] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.652632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.652632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.652632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.652632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.652632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46877f3c-88c5-453e-897c-5c4698b6a499 is going to be updated. [ 840.684881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.685190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.685386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.685681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.685874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.686227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.076024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.077678] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.256186] env[65455]: INFO networking_nsxv3.common.synchronization [req-0d2ec1af-f9e8-4710-ab53-0db8694d142f req-58e91b22-1e18-44c8-9c70-f3b725e12346 tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 841.258387] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 841.260114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.260114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.260114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.260742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.261172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.262599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.262599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.262599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.262599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.262599] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.578684] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.579062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.579062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.579154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.579252] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.579321] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 841.582437] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.582568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.582716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.582843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.582925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.583041] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be created. [ 841.609185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.609185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.609185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.609185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.609185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.611414] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.612842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.612842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.612842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.612842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.624799] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: UNINITIALIZED for 2s [ 841.625965] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 841.764854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.765081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.765081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.765336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.765433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.765644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.765758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.765809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.765947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.766035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.766122] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 841.802491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.802491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.802491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.802491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.802491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.814343] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 843.637848] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 843.638318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.638434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.638812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.638929] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.639109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.639183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.639369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.639459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.639562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.641615] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 843.642109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.642303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.642537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.643593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.643593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.643593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.643593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.643593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.643593] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.748374] env[65455]: INFO networking_nsxv3.common.synchronization [req-b5ae7ba5-e23f-4efb-83e7-69bb1fef09bc req-9f9864f2-566a-4877-8dce-3aa17cf746ec tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 843.748949] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 843.749643] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.749798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.749863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.750065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.750222] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.750317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.750677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.750859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.750978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.751103] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.825261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 843.825443] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 deletion is rescheduled due to dependency. [ 843.825572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.145546] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.146867] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.254573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.254848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.254848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.255079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.277087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.277353] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.277485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.277538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.277881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.277881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.277970] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 844.311416] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.311416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.311416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.311775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.312542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.331515] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 844.649740] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.651123] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.153719] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.155177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.155177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.155177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.155177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.155177] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 845.156447] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.156575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.157371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.157371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.157371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.157371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be updated. [ 845.187660] env[65455]: INFO networking_nsxv3.common.synchronization [None req-323e197a-9711-48d9-a690-3fd198001dfa None None] Enqueued Resource ID: 492cd6d8-6431-49b3-8311-0ede0894a2a2 with Priority: HIGHEST for action port [ 845.188450] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 492cd6d8-6431-49b3-8311-0ede0894a2a2 with Priority: HIGHEST for action port [ 845.188846] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-492cd6d8-6431-49b3-8311-0ede0894a2a2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.189726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-492cd6d8-6431-49b3-8311-0ede0894a2a2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.189808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-492cd6d8-6431-49b3-8311-0ede0894a2a2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.190093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-492cd6d8-6431-49b3-8311-0ede0894a2a2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.190280] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('492cd6d8-6431-49b3-8311-0ede0894a2a2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.195963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.195963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.195963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.196189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.196189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.203024] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.203221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.203221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.203457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.203608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.220632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 845.221437] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 845.693091] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 492cd6d8-6431-49b3-8311-0ede0894a2a2 [ 845.693423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.693636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.693701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.693919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.694035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.694119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:492cd6d8-6431-49b3-8311-0ede0894a2a2 already deleted. [ 845.694200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-492cd6d8-6431-49b3-8311-0ede0894a2a2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.070336] env[65455]: INFO networking_nsxv3.common.synchronization [req-ba7683de-c119-4c7f-b94f-23ea4aa97ed3 req-e9b3d769-bf86-4864-bd6b-673ce510b8c8 tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 846.070622] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 846.070932] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.071066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.071123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.071337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.071461] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.071724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.071724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.072483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.072483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.072483] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.342141] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 846.342393] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 846.342476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.533049] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.533271] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.533429] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.533702] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.533977] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.534157] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.534280] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.534533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.534678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.534880] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.534997] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.535148] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.535258] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.535369] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.535477] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.535630] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.555281] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.555673] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.556095] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.557838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-913" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.557838] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.557838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.557838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.557838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.557838] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d2acdfe-f180-4f22-a8a6-2eb445e8863b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.576045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.576045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.576045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.576045] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be deleted. [ 846.610731] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.610731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.610731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.611123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.611123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.611123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.063672] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.066304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 5d2acdfe-f180-4f22-a8a6-2eb445e8863b not found, creating... [ 847.066304] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.066304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.066806] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.066806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.066806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.066806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.066806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.066806] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 5d2acdfe-f180-4f22-a8a6-2eb445e8863b is going to be created. [ 847.093415] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.093415] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.093589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.094148] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.094148] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.094288] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.233888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 4s [ 847.234683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 4s [ 847.336571] env[65455]: INFO networking_nsxv3.common.synchronization [None req-4c393445-e89a-4f5c-9122-03d7f86f100a None None] Enqueued Resource ID: f8c84b6e-bcff-4c2d-a72c-54a176eab2b7 with Priority: HIGHEST for action port [ 847.337637] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c84b6e-bcff-4c2d-a72c-54a176eab2b7 with Priority: HIGHEST for action port [ 847.337908] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8c84b6e-bcff-4c2d-a72c-54a176eab2b7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.337908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8c84b6e-bcff-4c2d-a72c-54a176eab2b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.338095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8c84b6e-bcff-4c2d-a72c-54a176eab2b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.338466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8c84b6e-bcff-4c2d-a72c-54a176eab2b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.338586] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c84b6e-bcff-4c2d-a72c-54a176eab2b7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.490127] env[65455]: INFO networking_nsxv3.common.synchronization [None req-2fa7dcd7-b471-420b-87d1-f8aa6eab0e32 None None] Enqueued Resource ID: 907edf05-1504-4895-b065-61324aa5ab1b with Priority: HIGHEST for action port [ 847.490677] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 907edf05-1504-4895-b065-61324aa5ab1b with Priority: HIGHEST for action port [ 847.490988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-907edf05-1504-4895-b065-61324aa5ab1b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.491120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-907edf05-1504-4895-b065-61324aa5ab1b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.491202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-907edf05-1504-4895-b065-61324aa5ab1b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.491445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-907edf05-1504-4895-b065-61324aa5ab1b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.491576] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('907edf05-1504-4895-b065-61324aa5ab1b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.841723] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8c84b6e-bcff-4c2d-a72c-54a176eab2b7 [ 847.842046] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.842237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.842337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.842648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.843580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.843580] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8c84b6e-bcff-4c2d-a72c-54a176eab2b7 already deleted. [ 847.843580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8c84b6e-bcff-4c2d-a72c-54a176eab2b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.886172] env[65455]: INFO networking_nsxv3.common.synchronization [req-ba7683de-c119-4c7f-b94f-23ea4aa97ed3 req-a296dd18-141b-4cee-8a72-c1a8ed9de167 service nova] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 847.886411] env[65455]: INFO networking_nsxv3.common.synchronization [req-ba7683de-c119-4c7f-b94f-23ea4aa97ed3 req-a296dd18-141b-4cee-8a72-c1a8ed9de167 service nova] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 847.886633] env[65455]: INFO networking_nsxv3.common.synchronization [req-ba7683de-c119-4c7f-b94f-23ea4aa97ed3 req-a296dd18-141b-4cee-8a72-c1a8ed9de167 service nova] Enqueued Resource ID: 5d2acdfe-f180-4f22-a8a6-2eb445e8863b with Priority: HIGHEST for action port [ 847.887475] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_rules [ 847.887637] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 847.887725] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d2acdfe-f180-4f22-a8a6-2eb445e8863b with Priority: HIGHEST for action port [ 847.888012] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.888144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.888206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.888402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.888474] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.891015] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.891182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.891264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.891427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.891576] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.891668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.891720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.891849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.891936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.892043] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.893103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.893282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.893392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.893618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.893732] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d2acdfe-f180-4f22-a8a6-2eb445e8863b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.957021] env[65455]: INFO networking_nsxv3.common.synchronization [req-cf079373-b010-4fbf-ada4-c8edc3027078 req-26be78f8-8bf6-49d2-9d2c-dce154eb8803 tempest-ListServerFiltersTestJSON-1786060419 tempest-ListServerFiltersTestJSON-1786060419-project-member] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 847.957021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGHEST for action security_group_members [ 847.957021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958407] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.958675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.960975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.960975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.960975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.960975] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.993536] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 907edf05-1504-4895-b065-61324aa5ab1b [ 847.993536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.993729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.993900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.994162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.994936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.994936] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:907edf05-1504-4895-b065-61324aa5ab1b already deleted. [ 847.994936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-907edf05-1504-4895-b065-61324aa5ab1b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.158030] env[65455]: INFO networking_nsxv3.common.synchronization [None req-cb3a8d86-9ec0-483c-929a-c38458b8c12a tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 848.158783] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 848.159183] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.159400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.159498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.159803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.159934] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.312497] env[65455]: INFO networking_nsxv3.common.synchronization [None req-25f8c8c5-8ec8-444b-93bb-7bd2b591f5d7 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 848.312566] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 848.313773] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.313968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.362242] env[65455]: INFO networking_nsxv3.common.synchronization [req-f4902c8b-ff2e-41d8-af58-5164d8fb2ad5 req-2bfe9325-fcf5-4a37-b925-64814940ade6 tempest-ListImageFiltersTestJSON-37393499 tempest-ListImageFiltersTestJSON-37393499-project-member] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 848.362242] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 848.362242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.362942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.363112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.363361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.363904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.364959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.365055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.365230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.365316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.365408] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.400031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.400031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.400031] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.400031] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d2acdfe-f180-4f22-a8a6-2eb445e8863b with status ACTIVE [ 848.400031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.400031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.400031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.400031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.400031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.400031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.401109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.401109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.401607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.401607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.401607] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d2acdfe-f180-4f22-a8a6-2eb445e8863b is going to be updated. [ 848.456071] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.456324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.456378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.456645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.458247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.458247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d2acdfe-f180-4f22-a8a6-2eb445e8863b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.462768] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.462768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.462768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.462768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.462768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.462967] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.462967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.463057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.464647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.464647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.464647] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be updated. [ 848.509227] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.511207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.511207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.511207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.511207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.527505] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: IN_PROGRESS for 2s [ 848.684793] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.684793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.684925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.685077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.685163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.685308] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a already deleted. [ 848.685376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.685494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.685665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.685729] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.870024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.905562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.929565] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fc2a0c9-1deb-4dd8-89b9-0322cc3fb553 req-58586cdc-477e-4d05-8860-c65cbc3e3b27 tempest-ServerRescueTestJSON-1796748323 tempest-ServerRescueTestJSON-1796748323-project-member] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 848.930151] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 848.930491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.931209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.931209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.931335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.931455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.931615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.931699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.932214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.932214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.932214] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.212842] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.213666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.213666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.213666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.213666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.214993] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a already deleted. [ 849.214993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.250913] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 849.251241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.252138] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 849.252323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.252487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.252696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.252883] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.253184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.255059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.255273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.255366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.255462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.255557] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.256458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.256650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.256898] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.256971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.257045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.257191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.257273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.257443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.257443] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.358389] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.359623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.359623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.359623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.359623] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.359793] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.360011] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.360156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.360305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.361822] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.361822] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.361822] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.361822] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.361822] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.361822] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.361822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.369737] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.382534] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.382836] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.382836] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.383024] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.383727] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-03803909-c06c-4350-87de-a98b354875fd taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.383727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.383727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.383942] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.384444] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03803909-c06c-4350-87de-a98b354875fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.406856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.407049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.407208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.407421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.407507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.407605] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be created. [ 849.433258] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.433258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.433380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.435019] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.435147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.435147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.435499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.435499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.435740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.435844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.435908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.436098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.436188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.436275] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 already deleted. [ 849.436356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.445877] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: UNINITIALIZED for 2s [ 849.759400] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.762832] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.762832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.762832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.762832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.762832] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.762832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.762832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.763520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.763520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.763520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.763520] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.763520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.763695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.763851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.764030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.764311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.764435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.764596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.765157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.765157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.765157] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.873790] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.873790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.873790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.874089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.875220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.875220] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be updated. [ 849.889628] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.889838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.889958] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.890288] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.890432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.890579] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 03803909-c06c-4350-87de-a98b354875fd not found, creating... [ 849.890832] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.890981] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.891103] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.891317] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.892373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.892373] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.892373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.892373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.892373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.892603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.892603] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 03803909-c06c-4350-87de-a98b354875fd is going to be created. [ 849.909536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.909693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.909744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.910048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.911986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.921203] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.921203] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.921350] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.921557] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.921823] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.922069] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.924104] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 850.266884] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1da3b0d-71fb-478a-9ca1-c921e2456e4b: rpc.has_security_group_logging(os_id): False [ 850.268609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 850.313909] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.313909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.313909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.314188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.314406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.314551] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.314667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.314737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.314931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.315030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.315234] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be created. [ 850.320089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.320248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.320325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.320538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.320625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.320851] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.320982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.321052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.321202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.321285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.321511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.321604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.321676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.321849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.321973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.322284] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.322448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.322448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.323320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.323320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.323320] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 850.421292] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.422247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.422247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.422429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.422612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.426554] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.427645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.427645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.427645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.431186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.443902] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 850.449828] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 850.549594] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 in Status: SUCCESS [ 850.549594] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 deletion is rescheduled due to dependency. [ 850.549594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.680222] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1f488a97-7c49-4457-90bb-f323388d32c3 None None] Enqueued Resource ID: e9cffb4f-cdcf-4438-8543-ea6887782a70 with Priority: HIGHEST for action port [ 850.680705] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9cffb4f-cdcf-4438-8543-ea6887782a70 with Priority: HIGHEST for action port [ 850.681234] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9cffb4f-cdcf-4438-8543-ea6887782a70 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.681545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9cffb4f-cdcf-4438-8543-ea6887782a70" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.681832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9cffb4f-cdcf-4438-8543-ea6887782a70" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.682279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9cffb4f-cdcf-4438-8543-ea6887782a70" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.682547] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9cffb4f-cdcf-4438-8543-ea6887782a70',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.722476] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fc2a0c9-1deb-4dd8-89b9-0322cc3fb553 req-edb8dfd1-cd4e-44c8-8115-a989ae08c8c3 service nova] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_rules [ 850.722697] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fc2a0c9-1deb-4dd8-89b9-0322cc3fb553 req-edb8dfd1-cd4e-44c8-8115-a989ae08c8c3 service nova] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 850.722887] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fc2a0c9-1deb-4dd8-89b9-0322cc3fb553 req-edb8dfd1-cd4e-44c8-8115-a989ae08c8c3 service nova] Enqueued Resource ID: 03803909-c06c-4350-87de-a98b354875fd with Priority: HIGHEST for action port [ 850.723658] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_rules [ 850.723749] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 850.723829] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03803909-c06c-4350-87de-a98b354875fd with Priority: HIGHEST for action port [ 850.724146] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.724415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.724415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.726215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.726215] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.726215] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.726215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.726215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.726215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.726445] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.726445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.726445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.726552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.726631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.726730] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.728313] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-03803909-c06c-4350-87de-a98b354875fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.728443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.728543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.729235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.729235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03803909-c06c-4350-87de-a98b354875fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.187323] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9cffb4f-cdcf-4438-8543-ea6887782a70 [ 851.187570] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.187707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.187789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.188080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.188176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.188278] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9cffb4f-cdcf-4438-8543-ea6887782a70 already deleted. [ 851.188362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9cffb4f-cdcf-4438-8543-ea6887782a70" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.232122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.232384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.232799] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03803909-c06c-4350-87de-a98b354875fd with status ACTIVE [ 851.233140] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.233259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.233327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.233665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.233701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.233877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.233977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.234050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.234210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.234390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.234474] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.234557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.234618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.236071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.236071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.236179] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03803909-c06c-4350-87de-a98b354875fd is going to be updated. [ 851.237318] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.258654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.258784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.258844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.259065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.259225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.259382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03803909-c06c-4350-87de-a98b354875fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.458428] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 851.458877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.458972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.460477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.460477] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.460585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.460649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.460842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.460930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.461033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.462703] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.694027] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 851.694027] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 851.694027] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 851.694341] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 851.694380] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 851.694470] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 851.695274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.695404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.695468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.695703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.695801] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.695946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.695946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.696097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.696186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.696274] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.699040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-58afc773-e164-45a9-861a-3257739c7fd1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.699040] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.699741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.699741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.699741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.699741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.699963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.699963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.700037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.700958] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.739706] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.747067] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_rules [ 851.747272] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 851.747406] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_rules [ 851.747626] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 851.747695] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 851.747809] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 851.747889] env[65455]: INFO networking_nsxv3.common.synchronization [req-b8821737-39e7-4c13-b7a0-80f3fe434499 req-51dab837-7c72-43c8-a963-f09868ef6bf1 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 851.748410] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_rules [ 851.748546] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_rules [ 851.748644] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 851.748737] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46877f3c-88c5-453e-897c-5c4698b6a499 with Priority: HIGHEST for action port [ 851.748827] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_rules [ 851.748945] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 851.748995] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 851.751715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58afc773-e164-45a9-861a-3257739c7fd1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.753205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.753358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.753657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.754584] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.755562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.755686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.755901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.755979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.756132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-46877f3c-88c5-453e-897c-5c4698b6a499 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.756232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.756317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.756472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.756886] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46877f3c-88c5-453e-897c-5c4698b6a499',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.758071] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.758173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.758365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-58afc773-e164-45a9-861a-3257739c7fd1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.758447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.758899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.758990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.937450] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 851.937712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.964747] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.202924] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.203905] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.204800] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.241526] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.241685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.241752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.241968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.242106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.242257] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be created. [ 852.260506] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46877f3c-88c5-453e-897c-5c4698b6a499 with status ACTIVE [ 852.260735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.260960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.261360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.261550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.261652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.261953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.262146] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.262318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.262355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.262541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.262620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.262707] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46877f3c-88c5-453e-897c-5c4698b6a499 is going to be updated. [ 852.263851] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-58afc773-e164-45a9-861a-3257739c7fd1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.263944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.265319] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.265429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.265498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.265652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.265796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.278074] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: UNINITIALIZED for 2s [ 852.286478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.286478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.286478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.286478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.286840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.286840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46877f3c-88c5-453e-897c-5c4698b6a499" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.461761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 852.461761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.462178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.462234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.462389] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.465071] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 852.465071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.465356] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42a8d0a2-99ce-4c84-bb03-a9bf686e0924: rpc.has_security_group_logging(os_id): False [ 852.466354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.466544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.466629] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.484865] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.484959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.485009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.485202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.485292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.485593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.485712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.485773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.485934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.486032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.486106] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be created. [ 852.552960] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.555315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.555640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.558064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.558064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.573230] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: IN_PROGRESS for 2s [ 852.705580] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.706623] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.707446] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.965654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.965802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.969475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.969628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.211745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.211952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.211952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.213044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.213044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.213044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 853.213921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.213921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.213921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.214081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.214081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.214142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be updated. [ 853.215139] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.215241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.215346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.215453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.215528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.215908] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 is going to be created. [ 853.253781] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.253781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.253781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.254142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.254739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.268654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.268860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.268959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.269204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.269350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.271302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.271443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.271530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.271737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.272626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.288962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58afc773-e164-45a9-861a-3257739c7fd1 in Status: UNINITIALIZED for 2s [ 853.307211] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 853.307853] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 853.824490] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fd34c86-2eaa-4b47-b8c1-ea13b00d9095 req-c8cb33f0-b6ab-4ccc-8f62-1012c775a48b tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 853.824802] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 853.825378] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.825378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.825552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.825616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.825764] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.825858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.825920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.826093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.826180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.826277] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.227912] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.228122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.228276] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.228550] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.228997] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.228997] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.229148] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.229325] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.229478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.229688] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.229798] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.229909] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.230026] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.230157] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.230267] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.230430] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.254040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.254164] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.254213] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.254866] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.254866] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-2c233d1b-35a5-4083-831c-c619013fb0cb taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.254866] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.255106] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.255313] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.256029] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c233d1b-35a5-4083-831c-c619013fb0cb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.298892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 854.299334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.299996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.300348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.300635] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.300942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.300942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.301210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.302773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.303283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.303429] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.330522] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.588100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 854.588336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.758410] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.758646] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.758761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.759058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.759287] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.759450] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 2c233d1b-35a5-4083-831c-c619013fb0cb not found, creating... [ 854.759716] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.759871] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.759983] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.760222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.760347] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.760619] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.760769] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.760882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.761406] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.761567] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.761708] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 2c233d1b-35a5-4083-831c-c619013fb0cb is going to be created. [ 854.782693] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.782920] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.783054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.783342] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.783639] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.783898] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.808534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.808534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.808907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.808907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.809033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.809144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.809220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.809476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.809594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.809727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.809844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.810083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.810151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.810311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.810463] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.810572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.810639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.811527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.811527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.811527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.811527] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.834038] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.148405] env[65455]: INFO networking_nsxv3.common.synchronization [None req-2328a7fd-7eae-455d-8b10-595e6bcd9cbd None None] Enqueued Resource ID: 2ac745be-f27d-417e-a52a-91f440b2966f with Priority: HIGHEST for action port [ 855.148775] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac745be-f27d-417e-a52a-91f440b2966f with Priority: HIGHEST for action port [ 855.149097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac745be-f27d-417e-a52a-91f440b2966f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.149219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac745be-f27d-417e-a52a-91f440b2966f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.149319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac745be-f27d-417e-a52a-91f440b2966f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.150199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac745be-f27d-417e-a52a-91f440b2966f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.150351] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac745be-f27d-417e-a52a-91f440b2966f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.307681] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58afc773-e164-45a9-861a-3257739c7fd1 in Status: SUCCESS [ 855.309253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.311520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.312724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.313164] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.313164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.313164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.313451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.313451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.313534] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.314652] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86ef01d-dc8d-4d53-89c0-62ea8aeb7720: rpc.has_security_group_logging(os_id): False [ 855.329978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.329978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.329978] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.329978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.330326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.330326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.330326] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.331785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.331785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.331785] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.332267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.332267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.332267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.332267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.332267] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.339229] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.339439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.339543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.339746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.339824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.339886] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 855.350373] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.350674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.350674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.350851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.350964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.351370] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.351538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.351593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.351754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.351839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.352755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.352755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.352755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.352755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.352755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.352755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.353546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.353546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.353546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.353546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.353546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be created. [ 855.396600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.396918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.396918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.397394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.397590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.418561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 855.480029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.480029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.480029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.480029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.480029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.498642] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 855.597710] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fd34c86-2eaa-4b47-b8c1-ea13b00d9095 req-6ee0e36a-a3ed-42ba-ba80-d1e6e91eb621 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 855.597710] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fd34c86-2eaa-4b47-b8c1-ea13b00d9095 req-6ee0e36a-a3ed-42ba-ba80-d1e6e91eb621 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 855.597710] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fd34c86-2eaa-4b47-b8c1-ea13b00d9095 req-6ee0e36a-a3ed-42ba-ba80-d1e6e91eb621 service nova] Enqueued Resource ID: 2c233d1b-35a5-4083-831c-c619013fb0cb with Priority: HIGHEST for action port [ 855.599254] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 855.599254] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 855.599254] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c233d1b-35a5-4083-831c-c619013fb0cb with Priority: HIGHEST for action port [ 855.601147] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.601147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.601147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.601147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.601147] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.604052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.604052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.604052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c233d1b-35a5-4083-831c-c619013fb0cb taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.604227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.604300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.604543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.604679] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c233d1b-35a5-4083-831c-c619013fb0cb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.653349] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ac745be-f27d-417e-a52a-91f440b2966f [ 855.653349] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.653552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.653552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.654413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.654413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.654413] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ac745be-f27d-417e-a52a-91f440b2966f already deleted. [ 855.654413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac745be-f27d-417e-a52a-91f440b2966f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.821022] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.842886] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.843922] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.008854] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac9f503a-f659-4f50-9be2-3eed852ae1a9 req-d9359966-321e-4b38-8d87-a5d07e6229c2 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 856.009214] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac9f503a-f659-4f50-9be2-3eed852ae1a9 req-d9359966-321e-4b38-8d87-a5d07e6229c2 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 856.009340] env[65455]: INFO networking_nsxv3.common.synchronization [req-ac9f503a-f659-4f50-9be2-3eed852ae1a9 req-d9359966-321e-4b38-8d87-a5d07e6229c2 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 856.009984] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGHEST for action security_group_members [ 856.010221] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 856.010360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58afc773-e164-45a9-861a-3257739c7fd1 with Priority: HIGHEST for action security_group_members [ 856.010701] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.010850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.011119] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.011242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.011461] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-58afc773-e164-45a9-861a-3257739c7fd1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.011595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.104014] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.104190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.107044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c233d1b-35a5-4083-831c-c619013fb0cb with status ACTIVE [ 856.107044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.107306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.107395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.107651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.107756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.107972] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.108147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.108215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.108519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.108519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.109357] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.109357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.109357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.109357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.109357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.109357] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c233d1b-35a5-4083-831c-c619013fb0cb is going to be updated. [ 856.138823] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.139080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.139080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.139354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.139534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.139768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c233d1b-35a5-4083-831c-c619013fb0cb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.322984] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.345385] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.347030] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.503436] env[65455]: INFO networking_nsxv3.common.synchronization [req-cf4269d9-480d-44b5-92ac-eff401f11a6e req-32fe9585-2ceb-4f20-b84e-055288d2ca15 tempest-ServerAddressesNegativeTestJSON-1940115041 tempest-ServerAddressesNegativeTestJSON-1940115041-project-member] Enqueued Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 856.503436] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 856.503966] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.504297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.504485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.504835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.505141] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.505381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.505540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.505804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.506249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.506468] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.827809] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.828175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.828175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.828337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.828431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.828526] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 is going to be updated. [ 856.848813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.849117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.849117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.849333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.849555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.849661] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be updated. [ 856.851505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.851644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.851688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.851858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.851940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.852186] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 856.864517] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.864787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.864787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.866718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.866718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.873918] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58afc773-e164-45a9-861a-3257739c7fd1 in Status: IN_PROGRESS for 2s [ 856.889828] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.889968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.890594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.890594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.890594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.892556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.892556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.892556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.892556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.892781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.902940] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 856.903613] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 856.905620] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.905859] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-367" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.906025] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-367" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.906366] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-367" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.906664] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.906886] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.907052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.907306] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.907479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.907726] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.907915] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.908060] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.908219] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.908385] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.908525] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.908688] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.932168] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.932427] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.932572] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.932760] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-367" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.933107] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-ec72ddcf-ba99-4ded-acb2-ef116f865a94 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.933285] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.933402] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.933788] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.933965] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec72ddcf-ba99-4ded-acb2-ef116f865a94',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.009536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.010124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.010803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.010803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.011129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.012671] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.012794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.012935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.013170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.013259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.013367] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e637b5c5-e399-481c-982c-2851963e7c48 already deleted. [ 857.013483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.435995] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 857.436290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.436851] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.437090] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.437268] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.437603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.437762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.437915] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port ec72ddcf-ba99-4ded-acb2-ef116f865a94 not found, creating... [ 857.438218] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.438381] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.438499] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.438729] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.438867] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.439228] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.439536] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.439536] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.439728] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.439860] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.439998] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: ec72ddcf-ba99-4ded-acb2-ef116f865a94 is going to be created. [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.443028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.443028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.443028] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.473195] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.473438] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.473599] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.474127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.474234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.474487] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.512478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 857.512825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.911785] env[65455]: INFO networking_nsxv3.common.synchronization [None req-fcdcd422-0eab-418b-a6e2-b9b164310335 None None] Enqueued Resource ID: 2bd45feb-9c55-4aae-ad05-ce37399c9b6b with Priority: HIGHEST for action port [ 857.912151] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd45feb-9c55-4aae-ad05-ce37399c9b6b with Priority: HIGHEST for action port [ 857.912471] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd45feb-9c55-4aae-ad05-ce37399c9b6b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.912592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd45feb-9c55-4aae-ad05-ce37399c9b6b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.912698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd45feb-9c55-4aae-ad05-ce37399c9b6b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.912972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd45feb-9c55-4aae-ad05-ce37399c9b6b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.913068] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd45feb-9c55-4aae-ad05-ce37399c9b6b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.950087] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.961770] env[65455]: INFO networking_nsxv3.common.synchronization [None req-256bcd91-ff86-4e36-8f1e-cfa767bcb799 None None] Enqueued Resource ID: 2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5 with Priority: HIGHEST for action port [ 857.962044] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5 with Priority: HIGHEST for action port [ 857.962417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.962544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.962965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.963165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.963381] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.228157] env[65455]: INFO networking_nsxv3.common.synchronization [req-cf4269d9-480d-44b5-92ac-eff401f11a6e req-68b69f2b-d517-4677-a830-f954f4c6175f service nova] Enqueued Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_rules [ 858.228347] env[65455]: INFO networking_nsxv3.common.synchronization [req-cf4269d9-480d-44b5-92ac-eff401f11a6e req-68b69f2b-d517-4677-a830-f954f4c6175f service nova] Enqueued Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 858.228483] env[65455]: INFO networking_nsxv3.common.synchronization [req-cf4269d9-480d-44b5-92ac-eff401f11a6e req-68b69f2b-d517-4677-a830-f954f4c6175f service nova] Enqueued Resource ID: ec72ddcf-ba99-4ded-acb2-ef116f865a94 with Priority: HIGHEST for action port [ 858.229202] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_rules [ 858.229511] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 858.229803] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec72ddcf-ba99-4ded-acb2-ef116f865a94 with Priority: HIGHEST for action port [ 858.230169] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.230344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.230477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.231018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.231018] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.231935] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.232077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.232141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.232381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.232593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.232725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.232827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.233036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.233310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.233565] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.234964] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec72ddcf-ba99-4ded-acb2-ef116f865a94 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.234964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.234964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.235180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.235180] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec72ddcf-ba99-4ded-acb2-ef116f865a94',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.419165] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bd45feb-9c55-4aae-ad05-ce37399c9b6b [ 858.419367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.420013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.420013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.420013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.420222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.420365] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bd45feb-9c55-4aae-ad05-ce37399c9b6b already deleted. [ 858.420470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd45feb-9c55-4aae-ad05-ce37399c9b6b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.452086] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.465740] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5 [ 858.468975] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.468975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.468975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.468975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.468975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.468975] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5 already deleted. [ 858.468975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac22566-25fe-4ea7-a8a3-e61dc3aad3d5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.737446] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.738365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.738553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.740380] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec72ddcf-ba99-4ded-acb2-ef116f865a94 with status ACTIVE [ 858.740380] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.740380] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.740380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.743717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.743717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.743717] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec72ddcf-ba99-4ded-acb2-ef116f865a94 is going to be updated. [ 858.773351] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.773570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.773570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.773763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.773912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.774104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec72ddcf-ba99-4ded-acb2-ef116f865a94" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.891714] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58afc773-e164-45a9-861a-3257739c7fd1 in Status: SUCCESS [ 858.891935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.893432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.894291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.894291] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.894291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.894291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.894541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.894541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.894606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.895805] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.898893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.898893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.898893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.924522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 858.924899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.925609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.925875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.927660] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.927660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.927660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.927660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.927660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.927660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.930383] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.930383] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 858.930383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.930383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.930627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.930666] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.930816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.930916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.933441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.933441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.933858] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.935783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.936044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.939574] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.939574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.939574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.939574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.939574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.939574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.940066] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.942015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.942295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.942542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.942698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.942832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.943166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.943166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.943290] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.959433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.959748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.959827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.960256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.960256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.960381] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 859.009481] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.009701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.011829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.011829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.011829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.027291] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 859.241093] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.402970] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58afc773-e164-45a9-861a-3257739c7fd1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.406078] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.406078] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.406078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.406078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 is going to be deleted. [ 859.445085] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.445379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.445725] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.447039] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.448578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.448735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.448861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.449654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.449654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.449838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.449838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.450024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.450225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.450351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.450502] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be updated. [ 859.467490] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.467789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.467789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.468147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.468274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.468393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.496122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.496341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.496408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.498692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.498692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.509808] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 859.744442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.744656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.744731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.744991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.745108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.745216] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e637b5c5-e399-481c-982c-2851963e7c48 is going to be created. [ 859.777732] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.778614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.779233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.780642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.780855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.796610] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: UNINITIALIZED for 2s [ 859.909535] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58afc773-e164-45a9-861a-3257739c7fd1: rpc.has_security_group_logging(os_id): False [ 859.940080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.940080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.940080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.940547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.940547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.940547] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.940723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.940723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.940811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.940873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.940959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 is going to be created. [ 859.948747] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.952546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1da3b0d-71fb-478a-9ca1-c921e2456e4b: rpc.has_security_group_logging(os_id): False [ 859.963720] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1], does not exist path=[/infra/domains/default/groups/58afc773-e164-45a9-861a-3257739c7fd1]."\n}' [ 859.964190] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1 [ 859.964190] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 859.975606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.976258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.976258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.976258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.976258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.976690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.976690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.976690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.976690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.977043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.977043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be updated. [ 860.016355] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.016355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.016824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.016824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.018327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.018782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.019180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.019180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.019490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.019637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.019985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.020184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.020308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.020739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.020856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.021775] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58afc773-e164-45a9-861a-3257739c7fd1 is going to be created. [ 860.049027] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1], does not exist path=[/infra/domains/default/groups/58afc773-e164-45a9-861a-3257739c7fd1]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1 [ 860.049027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58afc773-e164-45a9-861a-3257739c7fd1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.049027] env[65455]: Traceback (most recent call last): [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 860.049027] env[65455]: return func(*args, **kwargs) [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 860.049027] env[65455]: res.raise_for_status() [ 860.049027] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 860.049027] env[65455]: raise HTTPError(http_error_msg, response=self) [ 860.049027] env[65455]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1 [ 860.049027] env[65455]: During handling of the above exception, another exception occurred: [ 860.049027] env[65455]: Traceback (most recent call last): [ 860.049027] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 860.049027] env[65455]: listener.cb(fileno) [ 860.049027] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 860.049027] env[65455]: result = function(*args, **kwargs) [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 860.049027] env[65455]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 860.049027] env[65455]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 860.049027] env[65455]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 860.049027] env[65455]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 860.049027] env[65455]: res.raise_for_status() [ 860.049027] env[65455]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 860.049027] env[65455]: raise HTTPError(http_error_msg, response=self) [ 860.049027] env[65455]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/58afc773-e164-45a9-861a-3257739c7fd1 [ 860.049027] env[65455]: Removing descriptor: 61 [ 860.058970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.059312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.059312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.059477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.060666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.083032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: IN_PROGRESS for 2s [ 860.455517] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.455517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.455517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.455517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.455517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.455517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 860.514828] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.514828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.514828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.515201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.515506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.526368] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 861.036677] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 861.037142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.037226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.037428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.037623] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.037744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.037808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.037983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.038088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.038243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.038386] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.221030] env[65455]: INFO networking_nsxv3.common.synchronization [None req-53d18385-278f-4f40-97e7-db661e6b53ab None None] Enqueued Resource ID: 568219d2-90f4-4426-b271-230639d9a546 with Priority: HIGHEST for action port [ 861.221285] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 568219d2-90f4-4426-b271-230639d9a546 with Priority: HIGHEST for action port [ 861.222012] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-568219d2-90f4-4426-b271-230639d9a546 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.222227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-568219d2-90f4-4426-b271-230639d9a546" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.223438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-568219d2-90f4-4426-b271-230639d9a546" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.223438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-568219d2-90f4-4426-b271-230639d9a546" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.223438] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('568219d2-90f4-4426-b271-230639d9a546',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.523080] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 861.523080] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b deletion is rescheduled due to dependency. [ 861.523080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.543740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.543740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.543740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.543740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.543740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.544431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.544431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.544431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.544431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.544431] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.725490] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 568219d2-90f4-4426-b271-230639d9a546 [ 861.725813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.726057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.726303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.726651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.726832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.727057] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:568219d2-90f4-4426-b271-230639d9a546 already deleted. [ 861.727387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-568219d2-90f4-4426-b271-230639d9a546" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.808523] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: SUCCESS [ 861.808782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.808962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.809414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.809470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.810666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.810666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.810666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.810666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.810666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.810666] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.045750] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 862.067039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.067039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.067039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.067039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.090427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.090427] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.090427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.090427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.090849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.090849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.090849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.090981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.090981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.091141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.091216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.091392] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.091487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.091547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.091720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.091764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.091838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 862.096588] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b in Status: SUCCESS [ 862.097299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.174792] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.174792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.174792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.174792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.174792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.187148] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 862.312638] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.312892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.312983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.313260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.313542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.313668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.313856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.313938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.314711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.314711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.314711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.314711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.314711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.315040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.315352] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.315731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.315731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.316680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.316750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.316967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.317061] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.542091] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.542091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.542091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.542091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.542091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.548471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.548471] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.823164] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e637b5c5-e399-481c-982c-2851963e7c48: rpc.has_security_group_logging(os_id): False [ 862.840954] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.841223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.841320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.841448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.841537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.841745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.841857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.841908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.842044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.842198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.842398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.842501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.842556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.842686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.842757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.842947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.843272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.843272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.843272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.843631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.843631] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e637b5c5-e399-481c-982c-2851963e7c48 is going to be created. [ 862.906833] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.907054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.907131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.907417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.907516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.921119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: IN_PROGRESS for 2s [ 863.048370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8ac4b88-966c-4479-95d3-80b154d92475: rpc.has_security_group_logging(os_id): False [ 863.068306] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.068481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.068524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.068866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.089537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.089868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.090088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.090500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.090500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.090593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.090834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.090955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.091030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.091834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.091834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.091834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.091834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.091834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.092086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.094188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.094430] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 863.168572] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.168734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.168787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.168993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.169172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.197371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 864.204483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 864.205102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.935984] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: SUCCESS [ 864.936270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.216703] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 865.217064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.980524] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f682cd0-c753-46e4-b125-23ac1e7a8a37 req-04098b83-f6c3-4adf-ac05-c88494335662 tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 865.982559] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 865.982559] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.982559] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.982559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.983083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.983083] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.248636] env[65455]: INFO networking_nsxv3.common.synchronization [None req-96f6e387-bd7b-488a-858d-2f547c6be09f None None] Enqueued Resource ID: 8e42d925-6933-4c4e-9c7c-f5e485f38d03 with Priority: HIGHEST for action port [ 866.249229] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e42d925-6933-4c4e-9c7c-f5e485f38d03 with Priority: HIGHEST for action port [ 866.249613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e42d925-6933-4c4e-9c7c-f5e485f38d03 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.249739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e42d925-6933-4c4e-9c7c-f5e485f38d03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.249799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e42d925-6933-4c4e-9c7c-f5e485f38d03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.254238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e42d925-6933-4c4e-9c7c-f5e485f38d03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.254400] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e42d925-6933-4c4e-9c7c-f5e485f38d03',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.491440] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.563920] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.564170] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.564330] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.564662] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.565797] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.566266] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.566395] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.566654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.566803] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.567215] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.567364] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.567489] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.567602] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.567731] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.567846] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.568086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.591902] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.592101] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.592245] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.592492] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.592894] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-6ff0a569-88b3-4436-bfc4-8b418a84a5de taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.593137] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.593305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.593704] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.593845] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff0a569-88b3-4436-bfc4-8b418a84a5de',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.756836] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8e42d925-6933-4c4e-9c7c-f5e485f38d03 [ 866.757234] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.757464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.757540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.757862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.758021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.758177] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8e42d925-6933-4c4e-9c7c-f5e485f38d03 already deleted. [ 866.758317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e42d925-6933-4c4e-9c7c-f5e485f38d03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.992333] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.096552] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.096770] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.096856] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.097301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.097574] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.097629] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 6ff0a569-88b3-4436-bfc4-8b418a84a5de not found, creating... [ 867.097919] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.098107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.098227] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.098478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.098614] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.098902] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.099065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.099187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.099433] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.099521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.099667] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 6ff0a569-88b3-4436-bfc4-8b418a84a5de is going to be created. [ 867.122849] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.123091] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.123263] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.123479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.123727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.123936] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.496703] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.497180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.497180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.497478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.497478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.497622] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 867.536872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.537113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.537205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.537471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.537672] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.556547] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 867.860770] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f682cd0-c753-46e4-b125-23ac1e7a8a37 req-717021cd-45fd-41e1-8505-fa2ce6097fd1 service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 867.860770] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f682cd0-c753-46e4-b125-23ac1e7a8a37 req-717021cd-45fd-41e1-8505-fa2ce6097fd1 service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 867.860893] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f682cd0-c753-46e4-b125-23ac1e7a8a37 req-717021cd-45fd-41e1-8505-fa2ce6097fd1 service nova] Enqueued Resource ID: 6ff0a569-88b3-4436-bfc4-8b418a84a5de with Priority: HIGHEST for action port [ 867.861720] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 867.861720] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 867.861720] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff0a569-88b3-4436-bfc4-8b418a84a5de with Priority: HIGHEST for action port [ 867.862070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.862239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.862272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.862586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.863097] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.866344] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.866344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.866901] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff0a569-88b3-4436-bfc4-8b418a84a5de taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.867971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.868054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.868310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.868446] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff0a569-88b3-4436-bfc4-8b418a84a5de',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.366534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.366830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.371188] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ff0a569-88b3-4436-bfc4-8b418a84a5de with status ACTIVE [ 868.372106] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.372106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.372106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.372106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.372106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.372618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.372618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.372618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.372618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.372618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.372795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.373031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.373031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.373216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.373216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.373301] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ff0a569-88b3-4436-bfc4-8b418a84a5de is going to be updated. [ 868.402923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.402923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.402923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.402923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.402923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.402923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff0a569-88b3-4436-bfc4-8b418a84a5de" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.832336] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fe5ec2d-6db4-4d18-a584-27f4cb8f6f13 req-89f4efe6-04eb-471e-8889-c9a1c972d23e tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 868.832907] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 868.836038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.836239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.836584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.836834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.839138] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.839463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.839463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.839856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.840475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.841894] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.031283] env[65455]: INFO networking_nsxv3.common.synchronization [None req-10752925-e14a-4e96-ab77-791282121d52 None None] Enqueued Resource ID: 091c2b84-594f-4914-92af-3816e8da0ebc with Priority: HIGHEST for action port [ 869.032031] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 091c2b84-594f-4914-92af-3816e8da0ebc with Priority: HIGHEST for action port [ 869.032388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-091c2b84-594f-4914-92af-3816e8da0ebc taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.032523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-091c2b84-594f-4914-92af-3816e8da0ebc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.032585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-091c2b84-594f-4914-92af-3816e8da0ebc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.032880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-091c2b84-594f-4914-92af-3816e8da0ebc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.032979] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('091c2b84-594f-4914-92af-3816e8da0ebc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.235311] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.235516] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.235640] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.235896] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.236164] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.236321] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.237448] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.238111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.238326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.238799] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.238799] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 869.239450] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 869.239646] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 869.239826] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 869.240213] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 869.240213] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 869.261503] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 869.261802] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 869.262235] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 869.262751] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.263279] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.263604] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.263873] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.264552] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.265603] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b49c178-8e01-4ac9-ac0c-70a61bd2c155',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.344547] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.344812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.345040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.346512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.369278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.369610] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.369764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.369838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.370042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.370130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.370219] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 869.396924] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.397204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.397311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.397694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.399513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.411492] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 869.537467] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 091c2b84-594f-4914-92af-3816e8da0ebc [ 869.538766] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.538766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.538766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.538766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.538766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.538766] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:091c2b84-594f-4914-92af-3816e8da0ebc already deleted. [ 869.538766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-091c2b84-594f-4914-92af-3816e8da0ebc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.572057] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 869.572300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.572465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.572682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.572875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.572990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.573759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.573759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.573759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.573759] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.662490] env[65455]: INFO networking_nsxv3.common.synchronization [None req-392d8eb2-77c6-4ee4-9d3e-da270b47231f None None] Enqueued Resource ID: 3885bff6-f1a0-48f7-9406-cc98fd92c21d with Priority: HIGHEST for action port [ 869.663057] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3885bff6-f1a0-48f7-9406-cc98fd92c21d with Priority: HIGHEST for action port [ 869.664271] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3885bff6-f1a0-48f7-9406-cc98fd92c21d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.664271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3885bff6-f1a0-48f7-9406-cc98fd92c21d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.664271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3885bff6-f1a0-48f7-9406-cc98fd92c21d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.664719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3885bff6-f1a0-48f7-9406-cc98fd92c21d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.664719] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3885bff6-f1a0-48f7-9406-cc98fd92c21d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.772128] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.772128] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 not found, creating... [ 869.772128] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.772128] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.772901] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.772901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.772901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.772901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.772901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.774032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 is going to be created. [ 869.807024] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.807313] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.807484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.807768] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.808059] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.808345] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.076898] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.166694] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3885bff6-f1a0-48f7-9406-cc98fd92c21d [ 870.167036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.167242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.167315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.167561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.167681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.167788] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3885bff6-f1a0-48f7-9406-cc98fd92c21d already deleted. [ 870.167878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3885bff6-f1a0-48f7-9406-cc98fd92c21d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.579823] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.607890] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fe5ec2d-6db4-4d18-a584-27f4cb8f6f13 req-a2618751-1a0d-4790-ae7a-77210e40289a service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 870.608965] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fe5ec2d-6db4-4d18-a584-27f4cb8f6f13 req-a2618751-1a0d-4790-ae7a-77210e40289a service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 870.608965] env[65455]: INFO networking_nsxv3.common.synchronization [req-4fe5ec2d-6db4-4d18-a584-27f4cb8f6f13 req-a2618751-1a0d-4790-ae7a-77210e40289a service nova] Enqueued Resource ID: 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 with Priority: HIGHEST for action port [ 870.608965] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 870.608965] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 870.608965] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 with Priority: HIGHEST for action port [ 870.609402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.609557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.609557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.609735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.609795] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.610709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.610827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.610985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.611201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.611274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.614020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.614020] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b49c178-8e01-4ac9-ac0c-70a61bd2c155',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.957495] env[65455]: INFO networking_nsxv3.common.synchronization [req-bcd3ea39-3241-4d09-9e67-11a656481097 req-0e4f7e23-a605-4cb7-969d-e6814d022c22 tempest-ServerMetadataTestJSON-492327230 tempest-ServerMetadataTestJSON-492327230-project-member] Enqueued Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 870.957623] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 870.957944] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.958102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.958161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.958413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.958561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.958661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.958721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.958867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.958949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.959094] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.082632] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.082920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.082920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.083243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.083243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.083427] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 871.113626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.114027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.114027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 with status ACTIVE [ 871.114173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.114280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.114341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.114552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.114637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.114832] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.114918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.117208] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.117208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.117208] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b49c178-8e01-4ac9-ac0c-70a61bd2c155 is going to be updated. [ 871.117919] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.118227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.118227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.118347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.118520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.129692] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 871.152288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.152453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.152525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.152779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.152909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.153091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b49c178-8e01-4ac9-ac0c-70a61bd2c155" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.409486] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.409486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-425" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.409486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-425" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.409486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-425" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.409838] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.410117] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.410548] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.410798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.411184] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.411944] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.413301] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.413597] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.414150] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.414150] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.414150] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.414350] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.430236] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 871.430380] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 871.430500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.430693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.430877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.431694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.431694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.431694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.431694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.431694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.431694] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.442085] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.442357] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.442461] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.442595] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-425" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.442894] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-2eea9bba-532d-4b3c-8413-ef44b59dc709 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.443060] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.443357] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.443566] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.443768] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eea9bba-532d-4b3c-8413-ef44b59dc709',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.462251] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.462338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.462381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.462593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.462771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.462868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.462964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.463047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.463242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.463295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.463349] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3313b461-f39b-4336-888c-410e1a4217c0 already deleted. [ 871.463426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.737910] env[65455]: INFO networking_nsxv3.common.synchronization [req-e525a284-3a64-47fc-8498-78a77ecca63e req-7ae38c65-c080-44ef-9d3f-165483d66d13 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 871.738165] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 871.738575] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.738677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.738718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.738897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.739060] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.739165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.739223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.739385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.739466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.739570] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.925481] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6b9ad23e-b7e1-44c9-81c8-d6381d88de9f None None] Enqueued Resource ID: 5e77e3c4-89af-4f34-96d3-991d29974757 with Priority: HIGHEST for action port [ 871.925481] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e77e3c4-89af-4f34-96d3-991d29974757 with Priority: HIGHEST for action port [ 871.925481] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e77e3c4-89af-4f34-96d3-991d29974757 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.925481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e77e3c4-89af-4f34-96d3-991d29974757" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.925481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e77e3c4-89af-4f34-96d3-991d29974757" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.925932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e77e3c4-89af-4f34-96d3-991d29974757" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.925932] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e77e3c4-89af-4f34-96d3-991d29974757',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.934015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.948137] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.949024] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.949024] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.949024] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.949563] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.949774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 2eea9bba-532d-4b3c-8413-ef44b59dc709 not found, creating... [ 871.950117] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.950344] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.950432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.950682] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.950820] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.952044] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.952044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.952044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.952044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.952044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.952044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 2eea9bba-532d-4b3c-8413-ef44b59dc709 is going to be created. [ 871.974822] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.974822] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.974822] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.974822] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.975195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.975305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.242446] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.429128] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e77e3c4-89af-4f34-96d3-991d29974757 [ 872.429128] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.429128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.429128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.430303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.430303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.430303] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e77e3c4-89af-4f34-96d3-991d29974757 already deleted. [ 872.430303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e77e3c4-89af-4f34-96d3-991d29974757" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.437823] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.745095] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.748538] env[65455]: INFO networking_nsxv3.common.synchronization [req-bcd3ea39-3241-4d09-9e67-11a656481097 req-6e320514-69fe-4092-a562-8b404f2091fc service nova] Enqueued Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_rules [ 872.748628] env[65455]: INFO networking_nsxv3.common.synchronization [req-bcd3ea39-3241-4d09-9e67-11a656481097 req-6e320514-69fe-4092-a562-8b404f2091fc service nova] Enqueued Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 872.748771] env[65455]: INFO networking_nsxv3.common.synchronization [req-bcd3ea39-3241-4d09-9e67-11a656481097 req-6e320514-69fe-4092-a562-8b404f2091fc service nova] Enqueued Resource ID: 2eea9bba-532d-4b3c-8413-ef44b59dc709 with Priority: HIGHEST for action port [ 872.749652] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_rules [ 872.749798] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 872.749904] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eea9bba-532d-4b3c-8413-ef44b59dc709 with Priority: HIGHEST for action port [ 872.750212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.750367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.750425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.750730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.750867] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.752492] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.752653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.752715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.753062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.753062] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.753240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.753301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.753587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.753587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.753665] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.754518] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eea9bba-532d-4b3c-8413-ef44b59dc709 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.754643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.754643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.754832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.754832] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eea9bba-532d-4b3c-8413-ef44b59dc709',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.941415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.941535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.941535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.941957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.942080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.942178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 872.974254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.974441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.974498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.974797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.974944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.985319] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 873.142060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 873.142329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.142538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.142776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.142973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.143144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.143214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.143380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.143461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.143593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.143694] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.250557] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.250840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.250840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.251020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.251095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.251241] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 873.256351] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.256487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.256684] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.260043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2eea9bba-532d-4b3c-8413-ef44b59dc709 with status ACTIVE [ 873.260415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.260546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.260609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.261249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.261349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.261552] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.261660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.261722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.261891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.261968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.262169] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.262264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.262385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.262462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.262533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.262683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2eea9bba-532d-4b3c-8413-ef44b59dc709 is going to be updated. [ 873.430926] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.432480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.432746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.433086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.433357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.438681] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.439144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.439330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.439700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.440025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.440322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eea9bba-532d-4b3c-8413-ef44b59dc709" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.452980] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 873.649074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.649074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.649074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.649883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.649883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.649883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.649883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.649883] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.761043] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.152808] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 874.175980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.175980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.175980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.175980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.201023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.201023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.201023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.201023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.201979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.201979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.201979] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 874.268022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.268022] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3313b461-f39b-4336-888c-410e1a4217c0 is going to be created. [ 874.268022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.268022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.268889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.269243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.312407] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 874.328035] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.328035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.328035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.328035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.328035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.342444] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: UNINITIALIZED for 2s [ 874.557056] env[65455]: INFO networking_nsxv3.common.synchronization [req-a883e3e4-bc94-4bbf-bdc4-74b4b85d51da req-99008d72-e106-4412-a81e-512957488494 tempest-ServerAddressesNegativeTestJSON-1940115041 tempest-ServerAddressesNegativeTestJSON-1940115041-project-member] Enqueued Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 874.557682] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e637b5c5-e399-481c-982c-2851963e7c48 with Priority: HIGHEST for action security_group_members [ 874.558051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e637b5c5-e399-481c-982c-2851963e7c48 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.558290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.558347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.558542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.558712] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.558815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.558883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.559041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.559130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.559227] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e637b5c5-e399-481c-982c-2851963e7c48',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.597118] env[65455]: INFO networking_nsxv3.common.synchronization [req-002cf791-afc5-4d11-8ae3-1ebabe2e4ae8 req-1f2d7f23-b8e6-4f61-aebd-d32e81d96151 tempest-ServersTestManualDisk-393770702 tempest-ServersTestManualDisk-393770702-project-member] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 874.597884] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 874.598252] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.598382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.598459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.598738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.598936] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.599062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.599124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.599304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.599399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.599490] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.952187] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-198 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.952389] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-198" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.952508] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-198" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.952831] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-198" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.953096] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.953306] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.953433] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.953654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.953792] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.953997] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.954347] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 874.954466] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 874.954573] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 874.954683] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 874.954785] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 874.954915] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 874.974932] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 874.975172] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 874.975316] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 874.975496] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-198" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.975860] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-25d8245d-80ef-4abd-b922-1354efb7bd4c taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.976538] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.976538] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.976538] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.977077] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25d8245d-80ef-4abd-b922-1354efb7bd4c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.998809] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 874.999148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.999388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.999678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.999942] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.000088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.000158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.000324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.000405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.000489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.000580] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.062425] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.062669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.062792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.063105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.063249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.063523] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.063673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.063770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.064016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.064137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.064270] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e637b5c5-e399-481c-982c-2851963e7c48 is going to be updated. [ 875.101199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.101199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.101199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.101351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.101400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.102588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.102701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.102763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.102929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.103043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.103203] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.103281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.103344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.103474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.103552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.103617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 already deleted. [ 875.103686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.112424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: IN_PROGRESS for 2s [ 875.472815] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 875.472815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.480905] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.481274] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.481449] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.481683] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.481844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.481992] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 25d8245d-80ef-4abd-b922-1354efb7bd4c not found, creating... [ 875.482360] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.482548] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.482681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.482947] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.483113] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.483450] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.483676] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.483777] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.484052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.484221] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.484378] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 25d8245d-80ef-4abd-b922-1354efb7bd4c is going to be created. [ 875.503727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.503900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.504078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.504231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.504417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.505051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.505051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.505051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.505051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.505051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.505268] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.505268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.505268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.505552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.505641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.505775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.505858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.506018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.506102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.506258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.506258] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.512896] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.514124] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.514644] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.516454] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.516454] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.516454] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.008343] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 876.039031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.039031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.041057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.041057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.041057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.041057] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.041764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.041764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.041764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.041764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.041764] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 876.113712] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.114017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.114194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.114475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.114597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.132022] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 876.255240] env[65455]: INFO networking_nsxv3.common.synchronization [req-002cf791-afc5-4d11-8ae3-1ebabe2e4ae8 req-f05827e2-f909-4436-a9cb-7fc9150432a7 service nova] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 876.255240] env[65455]: INFO networking_nsxv3.common.synchronization [req-002cf791-afc5-4d11-8ae3-1ebabe2e4ae8 req-f05827e2-f909-4436-a9cb-7fc9150432a7 service nova] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 876.255240] env[65455]: INFO networking_nsxv3.common.synchronization [req-002cf791-afc5-4d11-8ae3-1ebabe2e4ae8 req-f05827e2-f909-4436-a9cb-7fc9150432a7 service nova] Enqueued Resource ID: 25d8245d-80ef-4abd-b922-1354efb7bd4c with Priority: HIGHEST for action port [ 876.255471] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_rules [ 876.255643] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 876.255753] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d8245d-80ef-4abd-b922-1354efb7bd4c with Priority: HIGHEST for action port [ 876.256101] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.256246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.256300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.256514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.256594] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.257777] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.257945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.258049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.258308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.258898] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.259029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.259099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.259271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.259361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.259481] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.260366] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-25d8245d-80ef-4abd-b922-1354efb7bd4c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.260512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.260555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.260890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.260890] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25d8245d-80ef-4abd-b922-1354efb7bd4c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.329812] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 876.330457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.355769] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: SUCCESS [ 876.356149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.356392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.356629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.356855] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.357081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.357184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.357403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.357494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.357592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.357701] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.763170] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.764515] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.764752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.764806] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25d8245d-80ef-4abd-b922-1354efb7bd4c with status ACTIVE [ 876.765089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.765447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.765447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.765447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.765447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.765708] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.765791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.765791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.765934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.766039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.766204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.766306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.766354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.766471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.766550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.766746] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25d8245d-80ef-4abd-b922-1354efb7bd4c is going to be updated. [ 876.795819] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.796064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.796064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.796316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.796397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.796549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25d8245d-80ef-4abd-b922-1354efb7bd4c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.860971] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.860971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.860971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.860971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.860971] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.860971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.860971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.861432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.861432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.861432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.861542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.861598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.861661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.861801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.861940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.862112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.862180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.862323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.862398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.862491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.862569] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.125780] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e637b5c5-e399-481c-982c-2851963e7c48 in Status: SUCCESS [ 877.125939] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e637b5c5-e399-481c-982c-2851963e7c48 deletion is rescheduled due to dependency. [ 877.126062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e637b5c5-e399-481c-982c-2851963e7c48" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.270310] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.367181] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3313b461-f39b-4336-888c-410e1a4217c0: rpc.has_security_group_logging(os_id): False [ 877.391666] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.391822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.391875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.392109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.392195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.392424] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.392618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.392618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.392938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.393025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.396109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.396109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.396109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.396109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.396109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.396109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.396109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.398430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.398751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.398844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.398957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3313b461-f39b-4336-888c-410e1a4217c0 is going to be created. [ 877.493699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.493699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.493699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.493699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.493699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.506978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: IN_PROGRESS for 2s [ 877.773788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.774106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.774106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.774258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.774258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.774396] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 is going to be created. [ 877.818106] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.818311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.818358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.818555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.818720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.832224] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: UNINITIALIZED for 2s [ 878.150479] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 878.150479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.522400] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: SUCCESS [ 879.522400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.653430] env[65455]: INFO networking_nsxv3.common.synchronization [req-f29ddcfd-4248-4223-b103-7376f3ecce8f req-f835711d-7b17-46f9-811a-f177d2dd9c4b tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 879.654194] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 879.654537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.654653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.654727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.654974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.655619] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.655734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.656717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.656717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.656717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.656717] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.845067] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: SUCCESS [ 879.845213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.845391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.845617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.845820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.845939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.846010] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.846192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.846437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.846437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.846437] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.087967] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.087967] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.087967] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.088523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.089302] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.090110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.090110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.090207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.090311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.090557] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.090671] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.091806] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.091806] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.091806] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 880.091806] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.091806] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.119718] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.119718] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 880.119718] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.119899] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.120823] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.120823] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.120823] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.121034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.121166] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d63bfcb7-f06c-426c-bc9d-c0c2203a620e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.159215] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.159371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.159484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.159664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.184829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.184995] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.185158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.185229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.185623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.185623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.185739] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 880.215132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.215337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.215384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.215588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.215731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.226685] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 880.348569] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.623926] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.624360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.624360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.624782] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.624991] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.625174] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port d63bfcb7-f06c-426c-bc9d-c0c2203a620e not found, creating... [ 880.625456] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.625618] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.625732] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.625958] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.626112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.626401] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.626548] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.626659] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.626862] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.626992] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.627258] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: d63bfcb7-f06c-426c-bc9d-c0c2203a620e is going to be created. [ 880.651107] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.651107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.651416] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.651979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.651979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.652308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.853690] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 063ecd4f-5a85-4f8d-9ca3-d7222690dd83: rpc.has_security_group_logging(os_id): False [ 880.876788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.876914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.876951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.877670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.877670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.877877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.880042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.880042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.880042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.880042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.880042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 is going to be created. [ 880.996037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.996216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.996317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.996499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.996693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.012116] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: IN_PROGRESS for 2s [ 881.483570] env[65455]: INFO networking_nsxv3.common.synchronization [req-f29ddcfd-4248-4223-b103-7376f3ecce8f req-d6c72b0d-9d25-4bf9-be1b-cc7933583b81 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 881.483697] env[65455]: INFO networking_nsxv3.common.synchronization [req-f29ddcfd-4248-4223-b103-7376f3ecce8f req-d6c72b0d-9d25-4bf9-be1b-cc7933583b81 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 881.483808] env[65455]: INFO networking_nsxv3.common.synchronization [req-f29ddcfd-4248-4223-b103-7376f3ecce8f req-d6c72b0d-9d25-4bf9-be1b-cc7933583b81 service nova] Enqueued Resource ID: d63bfcb7-f06c-426c-bc9d-c0c2203a620e with Priority: HIGHEST for action port [ 881.487417] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 881.487417] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 881.487417] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d63bfcb7-f06c-426c-bc9d-c0c2203a620e with Priority: HIGHEST for action port [ 881.487417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.487417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.487417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.487417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.487417] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.489090] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.489229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.489494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.489615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.489694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.489866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.489946] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d63bfcb7-f06c-426c-bc9d-c0c2203a620e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.989819] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.989819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.996094] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d63bfcb7-f06c-426c-bc9d-c0c2203a620e with status ACTIVE [ 881.996094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.996094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.996094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.996094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.996094] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d63bfcb7-f06c-426c-bc9d-c0c2203a620e is going to be updated. [ 882.026539] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.026539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.026539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.026539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.026539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.026539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d63bfcb7-f06c-426c-bc9d-c0c2203a620e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.238258] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 882.238430] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 882.238549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.238750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.239371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.239371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.239512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.239583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.239737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.239824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.239929] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.742901] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.023746] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: SUCCESS [ 883.024096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.246439] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.750544] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.750544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.750544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.750544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.750544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.750544] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 883.783372] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.784087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.784215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.786650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.786650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.795855] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 885.807187] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 885.807587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.807661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.807900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.808149] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.808288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.808355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.808485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.808588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.808691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.808788] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.851194] env[65455]: INFO networking_nsxv3.common.synchronization [req-b750ac67-403f-46ea-977a-f5e4913d8a5f req-8403e07c-3277-4d91-8127-510a59d390b3 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 885.851730] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 885.852050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.852174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.852241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.852699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.852880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.852981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.853047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.853219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.853306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.853399] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.310993] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.311280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.311379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.311615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.311886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.312015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.312084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.312272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.312414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.312533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.312693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.312791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.312879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.313076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.313265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.313397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.313464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.314034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.314034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.314034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.314034] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.356651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.356651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.357192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.357498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.357598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.357804] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.357921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.358856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.358856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.358856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.358856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 886.391489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.391782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.391782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.392523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.392523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.405716] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 886.817058] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de94ae8c-64b4-4119-bf51-89a5595f402a: rpc.has_security_group_logging(os_id): False [ 886.840419] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.840622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.840622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.841020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.841020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.841193] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.841281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.841488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.841560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.841744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.841834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.841913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.842057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.842120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.842533] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.842533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.842533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.842800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.842883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.842970] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 886.932508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.932508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.932508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.932508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.932508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.947249] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 888.036184] env[65455]: INFO networking_nsxv3.common.synchronization [req-8016c4e5-4096-48e9-8eb6-fbd23d83055b req-df6ed349-7a2c-4c07-b460-a540aea17cbe tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 888.038028] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 888.038028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.038028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.038028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.038028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.038028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.038028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.038477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.038728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.038905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.039169] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.414714] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 888.414933] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 888.415093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.541967] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.581770] env[65455]: INFO networking_nsxv3.common.synchronization [req-dea04b28-2bbe-4e8a-8c9d-e4a2815ff104 req-f8f65df0-9f45-42b5-833f-f62c33e5ff85 tempest-ServerActionsV293TestJSON-876038749 tempest-ServerActionsV293TestJSON-876038749-project-member] Enqueued Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 888.581770] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ff894b-9924-4f71-b210-20859560462d with Priority: HIGHEST for action security_group_members [ 888.581770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-50ff894b-9924-4f71-b210-20859560462d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.581770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.585396] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.585396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.585396] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50ff894b-9924-4f71-b210-20859560462d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.966790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 888.969024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.047847] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.089723] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.089853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.089853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.090154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.112340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.112340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.112485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.112518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.112976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.112976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.112976] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50ff894b-9924-4f71-b210-20859560462d is going to be updated. [ 889.142958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.143203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.143249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.143465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.143614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.155625] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: IN_PROGRESS for 2s [ 889.550247] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.550426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.550560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.550757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.550881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.550987] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 889.582667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.582849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.582954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.583277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.583484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.594832] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 891.166849] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50ff894b-9924-4f71-b210-20859560462d in Status: SUCCESS [ 891.167350] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50ff894b-9924-4f71-b210-20859560462d deletion is rescheduled due to dependency. [ 891.167350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50ff894b-9924-4f71-b210-20859560462d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.605397] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 891.605660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.244557] env[65455]: INFO networking_nsxv3.common.synchronization [req-4012b934-3e01-4e4a-b172-cb793e2fecca req-8b28f00d-8f08-429a-a7d3-661cfc4f81f4 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 892.245352] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 892.245831] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.246369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.246369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.247990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.248236] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.248358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.248430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.248710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.248828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.248965] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.753086] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.753086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.753086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.753303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.753503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.753597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.753697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.753764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.753937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.754037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.754123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c already deleted. [ 892.754203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.802985] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.803322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.803508] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.804010] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.804477] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.804708] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.805250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.805250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.805433] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.805722] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.805884] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.806050] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.806174] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.806291] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.806400] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.806537] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.828680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.828859] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.829085] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.829386] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.829898] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-10639f42-172d-4ab9-ae14-817b3a77ca04 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.830161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.830368] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.830772] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.830948] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10639f42-172d-4ab9-ae14-817b3a77ca04',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.333916] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.334484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.334484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.334706] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.334892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.335190] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 10639f42-172d-4ab9-ae14-817b3a77ca04 not found, creating... [ 893.335767] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.335767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.335960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.336107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.336264] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.336635] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.336816] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.337057] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.337338] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.337492] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.337702] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 10639f42-172d-4ab9-ae14-817b3a77ca04 is going to be created. [ 893.372049] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.372376] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.372545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.372920] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.373252] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.373569] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.477876] env[65455]: INFO networking_nsxv3.common.synchronization [req-463e6ae2-b1f1-4706-b2f8-df2880a1f85a req-9b49dc2d-b8a5-42c9-ba33-b954b324eae9 tempest-ListImageFiltersTestJSON-37393499 tempest-ListImageFiltersTestJSON-37393499-project-member] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 893.478759] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGHEST for action security_group_members [ 893.479269] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.479500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.479617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.479904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.480273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.480429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.480528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.480799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.480941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.481115] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.983950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.984128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.984193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.984408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.005664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.006064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.006252] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.006356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.006632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.006754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.006885] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be updated. [ 894.039164] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.039365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.039406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.039605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.039750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.048944] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: IN_PROGRESS for 2s [ 894.084366] env[65455]: INFO networking_nsxv3.common.synchronization [req-4012b934-3e01-4e4a-b172-cb793e2fecca req-613f306f-fa13-44b6-821c-0372920dcd28 service nova] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_rules [ 894.084543] env[65455]: INFO networking_nsxv3.common.synchronization [req-4012b934-3e01-4e4a-b172-cb793e2fecca req-613f306f-fa13-44b6-821c-0372920dcd28 service nova] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 894.084747] env[65455]: INFO networking_nsxv3.common.synchronization [req-4012b934-3e01-4e4a-b172-cb793e2fecca req-613f306f-fa13-44b6-821c-0372920dcd28 service nova] Enqueued Resource ID: 10639f42-172d-4ab9-ae14-817b3a77ca04 with Priority: HIGHEST for action port [ 894.085331] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_rules [ 894.085471] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 894.085569] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10639f42-172d-4ab9-ae14-817b3a77ca04 with Priority: HIGHEST for action port [ 894.085836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.085957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.086033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.086386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.086386] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.087740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.088740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.088740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.088740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.088740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.088740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.088740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.088992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.088992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.088992] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.089978] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-10639f42-172d-4ab9-ae14-817b3a77ca04 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.090051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.090100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.090260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.090328] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10639f42-172d-4ab9-ae14-817b3a77ca04',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.374287] env[65455]: INFO networking_nsxv3.common.synchronization [req-41704df8-c85c-4764-9bbe-7a498fd31750 req-1b4f80e0-0226-4433-9cf2-0d5c005f983f tempest-ServerMetadataTestJSON-492327230 tempest-ServerMetadataTestJSON-492327230-project-member] Enqueued Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 894.374287] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3313b461-f39b-4336-888c-410e1a4217c0 with Priority: HIGHEST for action security_group_members [ 894.374660] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-3313b461-f39b-4336-888c-410e1a4217c0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.374660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.374805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.374901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.375067] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.375185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.375247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.375416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.375507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.375605] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3313b461-f39b-4336-888c-410e1a4217c0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.592395] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.592567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.592793] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.593705] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10639f42-172d-4ab9-ae14-817b3a77ca04 with status ACTIVE [ 894.594013] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.594013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.594013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.594230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.594340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.594450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.594556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.594599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.594818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.594818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.597054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.597054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.597054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.597054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.597054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.597054] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10639f42-172d-4ab9-ae14-817b3a77ca04 is going to be updated. [ 894.620110] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.620110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.620110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.620110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.620270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.620297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10639f42-172d-4ab9-ae14-817b3a77ca04" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.756261] env[65455]: INFO networking_nsxv3.common.synchronization [None req-56d86dcb-8337-4c4c-923a-fafc7a88f7b6 None None] Enqueued Resource ID: f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f with Priority: HIGHEST for action port [ 894.756852] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f with Priority: HIGHEST for action port [ 894.757534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.757678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.758008] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.758296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.758385] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.878738] env[65455]: INFO networking_nsxv3.common.synchronization [req-b4df0d01-8203-4aa9-89d3-d0427eb77a60 req-c61fbbd6-6b10-4d40-9e5d-a3787fef6692 tempest-ServersTestBootFromVolume-994483071 tempest-ServersTestBootFromVolume-994483071-project-member] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 894.879690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.879833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.879903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.880170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.880212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.880393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.880524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.880569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.880701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.880786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.880957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3313b461-f39b-4336-888c-410e1a4217c0 is going to be updated. [ 894.881927] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGHEST for action security_group_members [ 894.882532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.882633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.882677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.882844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.882990] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.883455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.883455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.883950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.883950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.883950] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.920794] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.920794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.920794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.920794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.920794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.929086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: IN_PROGRESS for 2s [ 895.098269] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.261118] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f [ 895.261118] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.261220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.261282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.261504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.261588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.261680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f already deleted. [ 895.261758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1a2c98b-f49d-4a7a-8f9a-ffacb2d87a9f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.386822] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.387848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.387848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.387848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.407737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.408260] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.408260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.408457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.408674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.408754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.408847] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd is going to be updated. [ 895.444095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.444258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.444330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.444554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.444693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.473896] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: IN_PROGRESS for 2s [ 895.600959] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.601167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.601231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.601415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.601505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.601602] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be created. [ 895.626123] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.626288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.626395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.626570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.626729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.640251] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: UNINITIALIZED for 2s [ 896.062267] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 in Status: SUCCESS [ 896.062516] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 deletion is rescheduled due to dependency. [ 896.062667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.939944] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3313b461-f39b-4336-888c-410e1a4217c0 in Status: SUCCESS [ 896.940236] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3313b461-f39b-4336-888c-410e1a4217c0 deletion is rescheduled due to dependency. [ 896.940276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3313b461-f39b-4336-888c-410e1a4217c0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.486388] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45b5142c-4bc9-41fd-a039-af08feb308fd in Status: SUCCESS [ 897.486616] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd deletion is rescheduled due to dependency. [ 897.486768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.650159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 897.650393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.650793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.650793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.651248] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.651248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.651248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.651427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.651427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.651543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.651601] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.154267] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.154605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.154605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.155697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.155697] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.155697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.155697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.155697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.155697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.155954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.155954] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.156071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.156135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.156288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.156430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.156547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.156611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.156800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.156833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.156911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.157014] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.661081] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9354847f-0991-42fd-9b0e-3a2865fde47c: rpc.has_security_group_logging(os_id): False [ 898.680717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.680924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.680965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.681311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.681517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.681698] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.681857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.681938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.682150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.682294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.682494] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.682676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.682751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.682922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.683019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.684120] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.684120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.684120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.684120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.684120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.684120] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be created. [ 898.796452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.797165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.797165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.797165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.797394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.816699] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 899.883412] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 899.883738] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 900.832856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 900.832856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.575046] env[65455]: INFO networking_nsxv3.common.synchronization [req-a811d144-2de3-4693-8001-4f65f65aa974 req-594ed97a-fd4c-4b9a-a4c0-74611342037c tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 901.575886] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 901.576450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.576668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.576841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.577134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.577388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.577648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.577777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.578012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.578133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.578236] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.939987] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.940212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.940419] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.940789] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.941098] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.941301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.941449] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.941727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.941875] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.942199] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.942399] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.942588] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.942777] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.942987] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.943194] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.943419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.964546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.964681] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.964827] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.964950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.965309] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-7ff923f7-5d7c-4c24-9398-8a4951e0b751 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.965489] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.965608] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.965929] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.966083] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff923f7-5d7c-4c24-9398-8a4951e0b751',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.082161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.082343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.082393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.082641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.082732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.082942] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.083061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.083115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.083290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.083365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.083457] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a already deleted. [ 902.083555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.469176] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.469538] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.469685] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.469977] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.470199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.470439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 7ff923f7-5d7c-4c24-9398-8a4951e0b751 not found, creating... [ 902.470749] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.470923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.471055] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.471298] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.471439] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.471728] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.471941] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.472112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.472325] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.472459] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.472609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 7ff923f7-5d7c-4c24-9398-8a4951e0b751 is going to be created. [ 902.495067] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.495369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.495493] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.495772] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.495997] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.496235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.907564] env[65455]: INFO networking_nsxv3.common.synchronization [req-56d2c07c-9897-44f3-a35e-22cbfc7a2e20 req-2e1f69ea-9750-4e71-b20c-63aba02bf532 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 902.907847] env[65455]: INFO networking_nsxv3.common.synchronization [req-56d2c07c-9897-44f3-a35e-22cbfc7a2e20 req-2e1f69ea-9750-4e71-b20c-63aba02bf532 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 902.907935] env[65455]: INFO networking_nsxv3.common.synchronization [req-56d2c07c-9897-44f3-a35e-22cbfc7a2e20 req-2e1f69ea-9750-4e71-b20c-63aba02bf532 tempest-SecurityGroupsTestJSON-435760640 tempest-SecurityGroupsTestJSON-435760640-project-member] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 902.908537] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGHEST for action security_group_members [ 902.908712] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8ac4b88-966c-4479-95d3-80b154d92475 with Priority: HIGHEST for action security_group_members [ 902.908825] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGHEST for action security_group_members [ 902.909182] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.909294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.909370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.909663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.909753] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.909844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.909907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.910094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.910184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.910290] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.911173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8ac4b88-966c-4479-95d3-80b154d92475 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.911280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.911374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.911493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.911634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.911731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.911775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.911919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.911989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.912083] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8ac4b88-966c-4479-95d3-80b154d92475',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.912831] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.912937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.913263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.913263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.913334] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.913377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.913444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.913553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.913627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.913713] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.261702] env[65455]: INFO networking_nsxv3.common.synchronization [req-a811d144-2de3-4693-8001-4f65f65aa974 req-4437a36c-97ce-433c-900c-06993d8df6fb service nova] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 903.261883] env[65455]: INFO networking_nsxv3.common.synchronization [req-a811d144-2de3-4693-8001-4f65f65aa974 req-4437a36c-97ce-433c-900c-06993d8df6fb service nova] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 903.262039] env[65455]: INFO networking_nsxv3.common.synchronization [req-a811d144-2de3-4693-8001-4f65f65aa974 req-4437a36c-97ce-433c-900c-06993d8df6fb service nova] Enqueued Resource ID: 7ff923f7-5d7c-4c24-9398-8a4951e0b751 with Priority: HIGHEST for action port [ 903.262687] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_rules [ 903.262801] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 903.262907] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff923f7-5d7c-4c24-9398-8a4951e0b751 with Priority: HIGHEST for action port [ 903.263329] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.263438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.263438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.263676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.263712] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.264679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.264826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.264883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.265070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.265401] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.265476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.265594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.266546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.266546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.266546] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.266879] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff923f7-5d7c-4c24-9398-8a4951e0b751 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.269056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.269056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.269056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.269056] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff923f7-5d7c-4c24-9398-8a4951e0b751',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.416345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.419820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.419820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.419820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.419820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.419820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.419820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.419820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.439121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.439121] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.439121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.439121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.439121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.439121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.439572] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be updated. [ 903.440413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.440413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.440413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.440619] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.440691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.440760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.440902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.440970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.441073] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 is going to be updated. [ 903.441877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.442052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.475853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.475998] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.476104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.476217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.476431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.476516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.476608] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be updated. [ 903.481062] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.481235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.481278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.481544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.481632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.483328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.483447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.483516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.483717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.483842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.494548] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: IN_PROGRESS for 2s [ 903.495335] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: IN_PROGRESS for 2s [ 903.538921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.538921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.538921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.538921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.538921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.550292] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: IN_PROGRESS for 2s [ 903.769553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.769718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.770998] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.771887] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ff923f7-5d7c-4c24-9398-8a4951e0b751 with status ACTIVE [ 903.772689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.772689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.772689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.772689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.772689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.772689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.772983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.772983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.772983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.773093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.773909] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.773909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.773909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.773909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.773909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.773909] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ff923f7-5d7c-4c24-9398-8a4951e0b751 is going to be updated. [ 903.795990] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.796140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.796208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.796415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.796544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.796697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff923f7-5d7c-4c24-9398-8a4951e0b751" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.275607] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.777875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.778071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.778124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.778402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.778492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.778594] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a is going to be created. [ 904.803449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.803665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.803728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.804050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.804229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.814615] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: UNINITIALIZED for 2s [ 905.236162] env[65455]: INFO networking_nsxv3.common.synchronization [req-b80a5bf3-c133-4d43-9dfe-f44051b87211 req-72979065-751a-4c1c-9cbb-0c457ec1f2fa tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 905.237165] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 905.237165] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.240852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.240852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.240852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.240852] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.240852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.240852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.241284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.241427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.241574] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.510215] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8ac4b88-966c-4479-95d3-80b154d92475 in Status: SUCCESS [ 905.510215] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8ac4b88-966c-4479-95d3-80b154d92475 deletion is rescheduled due to dependency. [ 905.510215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8ac4b88-966c-4479-95d3-80b154d92475" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.510215] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea in Status: SUCCESS [ 905.510691] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea deletion is rescheduled due to dependency. [ 905.510691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.562711] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 in Status: SUCCESS [ 905.563037] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 deletion is rescheduled due to dependency. [ 905.563221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.697053] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.698095] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.698095] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.698095] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.698095] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.698275] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.698418] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.699026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.699026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.699026] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.699170] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.699291] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.699424] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.699540] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.700029] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.700029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.722739] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.722920] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.723080] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.723257] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.723583] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-ab903784-6ff4-424b-b958-1a1eaca13410 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.723756] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.723878] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.724198] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.724337] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab903784-6ff4-424b-b958-1a1eaca13410',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.744214] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.229159] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.229159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port ab903784-6ff4-424b-b958-1a1eaca13410 not found, creating... [ 906.229159] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.229159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.230015] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.230015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.230015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.230015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.233851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.234611] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: ab903784-6ff4-424b-b958-1a1eaca13410 is going to be created. [ 906.250474] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.265555] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.265555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.265555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.265555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.265555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.265555] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.756387] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.756801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.757583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.757583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.757583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.757583] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 906.787224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.787705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.787842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.788109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.788239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.798087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 906.824743] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: SUCCESS [ 906.824993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.825313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.825631] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.825750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.825816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.826145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.826145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.826145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.826332] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.972141] env[65455]: INFO networking_nsxv3.common.synchronization [req-b80a5bf3-c133-4d43-9dfe-f44051b87211 req-ae005b70-1e30-4f0a-9442-3cf878f88415 service nova] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_rules [ 906.972141] env[65455]: INFO networking_nsxv3.common.synchronization [req-b80a5bf3-c133-4d43-9dfe-f44051b87211 req-ae005b70-1e30-4f0a-9442-3cf878f88415 service nova] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 906.972141] env[65455]: INFO networking_nsxv3.common.synchronization [req-b80a5bf3-c133-4d43-9dfe-f44051b87211 req-ae005b70-1e30-4f0a-9442-3cf878f88415 service nova] Enqueued Resource ID: ab903784-6ff4-424b-b958-1a1eaca13410 with Priority: HIGHEST for action port [ 906.972358] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_rules [ 906.972391] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 906.972474] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab903784-6ff4-424b-b958-1a1eaca13410 with Priority: HIGHEST for action port [ 906.974113] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.974113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.974113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.974113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.974113] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.974113] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.974113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.974365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab903784-6ff4-424b-b958-1a1eaca13410 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.974430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.974464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.975009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.975009] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab903784-6ff4-424b-b958-1a1eaca13410',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.328543] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.476869] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.476869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.477098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab903784-6ff4-424b-b958-1a1eaca13410 with status ACTIVE [ 907.477390] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.477580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.477676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.477891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.477983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.478164] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.478256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.478385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.478641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.478747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.478945] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.479061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.479140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.479266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.479340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.479424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab903784-6ff4-424b-b958-1a1eaca13410 is going to be updated. [ 907.502836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.502836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.502836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.503132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.503132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.503319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab903784-6ff4-424b-b958-1a1eaca13410" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.831307] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06a1d99f-1f74-4491-ba68-95d6af0beb2a: rpc.has_security_group_logging(os_id): False [ 907.854872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.855053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.855127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.855475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.855664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.855979] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.856112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.856194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.856830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.856830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.856830] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a is going to be created. [ 907.862143] env[65455]: INFO networking_nsxv3.common.synchronization [req-29d2c97a-b8ad-43f3-9730-c853426980b6 req-95402b7a-cb5f-49d7-b92a-b8d89a11a479 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 907.863059] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 907.863506] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.863707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.863707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.863992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.864273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.864432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.864542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.864729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.864866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.865042] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.935940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.936144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.938800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.938800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.938800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.953291] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: IN_PROGRESS for 2s [ 908.267926] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.268130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.270070] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.270070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.271037] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.271037] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.271037] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.271037] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.271037] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.271037] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.271037] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.293234] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.295362] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.295362] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.295362] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.295362] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-d2dada69-f1b9-452b-be60-710291fca3b7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.295362] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.295362] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.295362] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.295362] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2dada69-f1b9-452b-be60-710291fca3b7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.367886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.368063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.368177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.368373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.368484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.368739] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.368883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.368883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.369065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.369136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.369227] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 already deleted. [ 908.369306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.798577] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.798798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.798924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.799235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.799400] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.799560] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port d2dada69-f1b9-452b-be60-710291fca3b7 not found, creating... [ 908.799856] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.800026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.800145] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.800370] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.800503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.800816] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.800973] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.801103] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.801308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.801441] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.801581] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: d2dada69-f1b9-452b-be60-710291fca3b7 is going to be created. [ 908.814221] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 908.814467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.814766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.815027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.815246] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.815394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.815433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.815605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.815690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.815789] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.824707] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.824926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.825061] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.825390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.825621] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.825855] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.318862] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.471571] env[65455]: INFO networking_nsxv3.common.synchronization [req-9d651cda-14c7-42d5-83a4-4438a7a37142 req-a3a89b55-3c03-413d-8181-bc7eafe98c1c tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 909.472354] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 909.472886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.473045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.473104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.473294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.473464] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.473567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.473637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.473798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.473889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.473986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.605294] env[65455]: INFO networking_nsxv3.common.synchronization [req-29d2c97a-b8ad-43f3-9730-c853426980b6 req-e6f38796-bcbe-44ce-97cc-dd708a0a1d6f service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 909.605294] env[65455]: INFO networking_nsxv3.common.synchronization [req-29d2c97a-b8ad-43f3-9730-c853426980b6 req-e6f38796-bcbe-44ce-97cc-dd708a0a1d6f service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 909.608473] env[65455]: INFO networking_nsxv3.common.synchronization [req-29d2c97a-b8ad-43f3-9730-c853426980b6 req-e6f38796-bcbe-44ce-97cc-dd708a0a1d6f service nova] Enqueued Resource ID: d2dada69-f1b9-452b-be60-710291fca3b7 with Priority: HIGHEST for action port [ 909.608473] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 909.608473] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 909.608473] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2dada69-f1b9-452b-be60-710291fca3b7 with Priority: HIGHEST for action port [ 909.608473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.608473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.608473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.608473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.608473] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.610750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.610750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.610750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.610750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.610750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.610750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.610750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.611117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.611462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.611462] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.613131] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2dada69-f1b9-452b-be60-710291fca3b7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.613131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.617723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.617965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.618080] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2dada69-f1b9-452b-be60-710291fca3b7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.821221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.963304] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: SUCCESS [ 909.963542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.976201] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.976346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.976462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.976640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.976730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.976929] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.977044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.977120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.977295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.977439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.977518] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 910.008992] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.008992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.008992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.008992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.008992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.017091] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 910.120537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.120798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.120994] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.122707] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2dada69-f1b9-452b-be60-710291fca3b7 with status ACTIVE [ 910.122974] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.123068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.123188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.123325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.123584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.123782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.123883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.123965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.124123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.124225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.124379] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.124467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.124546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.124885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.124885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.124885] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2dada69-f1b9-452b-be60-710291fca3b7 is going to be updated. [ 910.152370] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.152453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.152485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.152697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.152828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.152991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2dada69-f1b9-452b-be60-710291fca3b7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.324255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.324641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.324641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.324641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.324847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.325829] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 910.370743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.371029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.371287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.371694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.371906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.392515] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 910.539625] env[65455]: INFO networking_nsxv3.common.synchronization [req-d3296ddd-1c6d-440e-812e-0b3c64ef2fac req-96db0a93-6ac6-4835-97f5-734da31a68ab tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 910.540253] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 910.540605] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.540716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.623912] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.910708] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.910708] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.910708] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.910966] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.911693] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.911693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.911693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.911693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.913059] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.913059] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.913059] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.913059] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.913059] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.913059] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.913226] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.913275] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.936784] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.936939] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.937095] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.937307] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.937699] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-2bc0a527-4511-4e62-906f-f98e9087de01 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.937897] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.938037] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.938417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.938570] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc0a527-4511-4e62-906f-f98e9087de01',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.126743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.126927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.126975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.127193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.127296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.127451] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be created. [ 911.156664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.156813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.156933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.157103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.157265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.168829] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: UNINITIALIZED for 2s [ 911.441039] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.441393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.441771] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.442247] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.442488] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.442717] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 2bc0a527-4511-4e62-906f-f98e9087de01 not found, creating... [ 911.443035] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.443250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.443405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.443665] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.444348] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.444348] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.444526] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.444526] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.444765] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.444923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.445476] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 2bc0a527-4511-4e62-906f-f98e9087de01 is going to be created. [ 911.467587] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.467895] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.467931] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.468238] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.468552] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.468698] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.029666] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 912.030018] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 912.030110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.200967] env[65455]: INFO networking_nsxv3.common.synchronization [req-d3296ddd-1c6d-440e-812e-0b3c64ef2fac req-90e2f809-1663-49b1-a3fd-9ec053e46858 service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 912.201200] env[65455]: INFO networking_nsxv3.common.synchronization [req-d3296ddd-1c6d-440e-812e-0b3c64ef2fac req-90e2f809-1663-49b1-a3fd-9ec053e46858 service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 912.201298] env[65455]: INFO networking_nsxv3.common.synchronization [req-d3296ddd-1c6d-440e-812e-0b3c64ef2fac req-90e2f809-1663-49b1-a3fd-9ec053e46858 service nova] Enqueued Resource ID: 2bc0a527-4511-4e62-906f-f98e9087de01 with Priority: HIGHEST for action port [ 912.201845] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 912.201979] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 912.205071] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc0a527-4511-4e62-906f-f98e9087de01 with Priority: HIGHEST for action port [ 912.206375] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.206375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.206375] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.206375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.206715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bc0a527-4511-4e62-906f-f98e9087de01 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.206715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.206715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.206895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.206977] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bc0a527-4511-4e62-906f-f98e9087de01',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.408693] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.408693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.408693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.408693] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.710024] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2bc0a527-4511-4e62-906f-f98e9087de01 with status ACTIVE [ 912.712268] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.712268] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.712268] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.712268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.712268] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2bc0a527-4511-4e62-906f-f98e9087de01 is going to be updated. [ 912.746934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.747099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.747162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.747372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.747684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.747736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bc0a527-4511-4e62-906f-f98e9087de01" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.910417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.910585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.910746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.910975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.911161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.911267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.911330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.911531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.911620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.911706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.911851] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.911944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.912012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.912162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.912352] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.912442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.912442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.912577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.912650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.912728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.912817] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.184198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 913.184198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.184730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.185330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.185330] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.185330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.185535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.185601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.185688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.185778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.185877] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.186741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.186922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.187096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.187223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.187294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.187502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.187610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.187689] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.414944] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9354847f-0991-42fd-9b0e-3a2865fde47c: rpc.has_security_group_logging(os_id): False [ 913.445488] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.445488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.445852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.447109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.447263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.447996] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.448176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.448176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.448364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.448436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.449109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.449109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.449266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.449393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.449444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.449644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.449731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.449785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.449944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.450017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.450105] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 913.555536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.555720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.556153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.556153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.556153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.575092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 913.690099] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.690257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.690327] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.193695] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.696664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.696853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.696894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.697122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.697213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.697313] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 914.726687] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.726829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.726829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.727029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.727193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.738034] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 915.354115] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7e9317a2-0dd4-4d10-91c3-7c92aa6c58a7 None None] Enqueued Resource ID: 280fb5c5-5e3e-4642-a6a3-9e03188dd417 with Priority: HIGHEST for action port [ 915.354914] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280fb5c5-5e3e-4642-a6a3-9e03188dd417 with Priority: HIGHEST for action port [ 915.355365] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-280fb5c5-5e3e-4642-a6a3-9e03188dd417 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.355543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-280fb5c5-5e3e-4642-a6a3-9e03188dd417" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.355681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-280fb5c5-5e3e-4642-a6a3-9e03188dd417" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.355975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-280fb5c5-5e3e-4642-a6a3-9e03188dd417" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.356142] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('280fb5c5-5e3e-4642-a6a3-9e03188dd417',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.597580] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 915.597851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.728609] env[65455]: INFO networking_nsxv3.common.synchronization [req-05cb0ecc-0ed5-49c9-846a-eb73d53ada36 req-4a1f54b5-7398-4ec6-b95b-698a9022f1e6 tempest-ServersNegativeTestMultiTenantJSON-1539234573 tempest-ServersNegativeTestMultiTenantJSON-1539234573-project-member] Enqueued Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 915.730012] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 915.732096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.732754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.732754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.732871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.733181] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.733352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.733493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.734029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.734029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.734235] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.858937] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 280fb5c5-5e3e-4642-a6a3-9e03188dd417 [ 915.859288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.859653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.859653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.859777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.859895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.860042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:280fb5c5-5e3e-4642-a6a3-9e03188dd417 already deleted. [ 915.860186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-280fb5c5-5e3e-4642-a6a3-9e03188dd417" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.178911] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-644 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.179110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-644" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.179280] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-644" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.179654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-644" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.179880] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.180070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.180296] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.180422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.180690] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.180817] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.180866] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.181010] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.181089] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.181200] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.181302] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.181431] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.203680] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.203950] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.204129] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.204311] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-644" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.204625] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-a7fc5517-81f6-48ee-98cb-c481eff34aea taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.204852] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.204931] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.205268] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.205496] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fc5517-81f6-48ee-98cb-c481eff34aea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.239185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.239461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.239461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.239698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.239748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.239936] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.240050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.240114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.240280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.241034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.241034] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 already deleted. [ 916.241034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.427746] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f64eafc1-f494-4543-b786-9d3d9491eb9e tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 916.428912] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 916.428912] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.430073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.430073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.430073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.430073] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.564368] env[65455]: INFO networking_nsxv3.common.synchronization [None req-b1303706-a008-483e-adff-540bc87bed2f tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 916.564368] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 916.564368] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.564368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.708479] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.708747] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.708891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.709199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.709373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.709548] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port a7fc5517-81f6-48ee-98cb-c481eff34aea not found, creating... [ 916.709835] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.709993] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.710139] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.710396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.710541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.710827] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.710978] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.711107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.711317] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.711447] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.711584] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: a7fc5517-81f6-48ee-98cb-c481eff34aea is going to be created. [ 916.733476] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.733693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.737020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.737020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.737020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.737020] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.748051] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 916.748274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.748441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.748902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.748902] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.749045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.749045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.749230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.749271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.749354] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.953545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.953734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.953787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.954068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.954181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.954329] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 already deleted. [ 916.954477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.954725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.954956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.955110] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.251776] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.479437] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.479899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.479899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.479899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.480049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.480077] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 already deleted. [ 917.480172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [req-05cb0ecc-0ed5-49c9-846a-eb73d53ada36 req-018f3046-d19e-4870-bdbf-163a64a5115b service nova] Enqueued Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_rules [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [req-05cb0ecc-0ed5-49c9-846a-eb73d53ada36 req-018f3046-d19e-4870-bdbf-163a64a5115b service nova] Enqueued Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [req-05cb0ecc-0ed5-49c9-846a-eb73d53ada36 req-018f3046-d19e-4870-bdbf-163a64a5115b service nova] Enqueued Resource ID: a7fc5517-81f6-48ee-98cb-c481eff34aea with Priority: HIGHEST for action port [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_rules [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 917.562503] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fc5517-81f6-48ee-98cb-c481eff34aea with Priority: HIGHEST for action port [ 917.563116] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.563263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.563263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.565243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.565243] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.566722] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.566722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.566722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.566915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.568039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.568039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.568039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.568039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.568039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.568039] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.568641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7fc5517-81f6-48ee-98cb-c481eff34aea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.569843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.569943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.570348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.570961] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fc5517-81f6-48ee-98cb-c481eff34aea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.754518] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.072509] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.074877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.074877] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7fc5517-81f6-48ee-98cb-c481eff34aea with status ACTIVE [ 918.074877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.074877] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.074877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.075408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.075408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.075408] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.075408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.075408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.075738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.075738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.075790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7fc5517-81f6-48ee-98cb-c481eff34aea is going to be updated. [ 918.098072] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.098682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.098682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.098839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.099568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.099568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7fc5517-81f6-48ee-98cb-c481eff34aea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.138754] env[65455]: INFO networking_nsxv3.common.synchronization [None req-57399073-5a01-4d48-89b8-84aeede0f3a0 None None] Enqueued Resource ID: 9572b148-aeb2-47aa-adbe-354f3415b718 with Priority: HIGHEST for action port [ 918.140655] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9572b148-aeb2-47aa-adbe-354f3415b718 with Priority: HIGHEST for action port [ 918.140655] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9572b148-aeb2-47aa-adbe-354f3415b718 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.140655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9572b148-aeb2-47aa-adbe-354f3415b718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.140655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9572b148-aeb2-47aa-adbe-354f3415b718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.140655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9572b148-aeb2-47aa-adbe-354f3415b718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.140655] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9572b148-aeb2-47aa-adbe-354f3415b718',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.258091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.258285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.258381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.258661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.258794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.259185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 918.317821] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.317821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.317998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.318247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.318631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.331749] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 918.520255] env[65455]: INFO networking_nsxv3.common.synchronization [req-70c1bb1d-487b-40fc-a489-9736ef51050a req-2f5dfe4f-6867-43bb-845f-2d019693d5f2 tempest-ServerRescueTestJSON-1796748323 tempest-ServerRescueTestJSON-1796748323-project-member] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 918.520690] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 918.521026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.521791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.521899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.522133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.522300] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.522405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.522478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.522627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.522709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.522819] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.576947] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.644152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9572b148-aeb2-47aa-adbe-354f3415b718 [ 918.644442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.644650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.644721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.644976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.645100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.645215] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9572b148-aeb2-47aa-adbe-354f3415b718 already deleted. [ 918.645381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9572b148-aeb2-47aa-adbe-354f3415b718" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.008375] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.008650] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.008811] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.009133] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.009384] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.009562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.009675] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.009897] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.010212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.010459] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.010579] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.010690] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.010828] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.010947] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.011049] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.011225] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.025146] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.035761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.036204] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.036275] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.037126] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-135" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.037636] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-8534232f-77a6-4d54-86db-51030f256d40 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.038418] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.038418] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.038613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.039595] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8534232f-77a6-4d54-86db-51030f256d40',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.081249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.081408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.081482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.081693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.081812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.082286] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 is going to be created. [ 919.116401] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.116401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.116401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.116401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.116401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.129294] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: UNINITIALIZED for 2s [ 919.527787] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.541967] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.542237] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.542374] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.542679] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.542820] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.542993] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 8534232f-77a6-4d54-86db-51030f256d40 not found, creating... [ 919.543291] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.543470] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.543633] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.543898] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.544083] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.546385] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.546385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.546385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.546385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.546385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.546385] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 8534232f-77a6-4d54-86db-51030f256d40 is going to be created. [ 919.569179] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.569179] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.569179] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.569179] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.569179] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.569179] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.030813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.030813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.031063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.031369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.031505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.031694] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be updated. [ 920.063617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.063765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.063765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.064017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.064259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075491] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 920.320107] env[65455]: INFO networking_nsxv3.common.synchronization [req-70c1bb1d-487b-40fc-a489-9736ef51050a req-b6914139-40ff-455d-a4f2-134ab09f5149 service nova] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_rules [ 920.320107] env[65455]: INFO networking_nsxv3.common.synchronization [req-70c1bb1d-487b-40fc-a489-9736ef51050a req-b6914139-40ff-455d-a4f2-134ab09f5149 service nova] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 920.320107] env[65455]: INFO networking_nsxv3.common.synchronization [req-70c1bb1d-487b-40fc-a489-9736ef51050a req-b6914139-40ff-455d-a4f2-134ab09f5149 service nova] Enqueued Resource ID: 8534232f-77a6-4d54-86db-51030f256d40 with Priority: HIGHEST for action port [ 920.320777] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_rules [ 920.320777] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 920.320885] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8534232f-77a6-4d54-86db-51030f256d40 with Priority: HIGHEST for action port [ 920.321167] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.321331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.321422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.322661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.322661] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.323055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.323478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.324482] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-8534232f-77a6-4d54-86db-51030f256d40 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.324617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.324669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.324871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.324965] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8534232f-77a6-4d54-86db-51030f256d40',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.345025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 920.345025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.345025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.345025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.345025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.345025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.345025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.345805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.346189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.346462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.349158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.349158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.349158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.349158] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.827738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.828102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.828102] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8534232f-77a6-4d54-86db-51030f256d40 with status ACTIVE [ 920.828252] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.828360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.828421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.828711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.828847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.829048] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.829151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.829214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.830594] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.830594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.830594] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8534232f-77a6-4d54-86db-51030f256d40 is going to be updated. [ 920.851768] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c376506d-a918-477c-96df-60ae10c0bcb8: rpc.has_security_group_logging(os_id): False [ 920.854679] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.854840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.854893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.855093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.855235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.855414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8534232f-77a6-4d54-86db-51030f256d40" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.873803] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.875818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.875945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.876213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.876296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.876905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.876905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.876905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.876905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.877371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.877371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.877371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.877371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.877514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.877618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.877765] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.877875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.877941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.878181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.878275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.878377] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be created. [ 920.979549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.979837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.979937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.982063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.982063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.999388] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 921.141187] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: SUCCESS [ 921.141809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.142517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.142517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.142657] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.142657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.142925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.142925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.142925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.143094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.143123] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.243196] env[65455]: INFO networking_nsxv3.common.synchronization [req-4be20ca4-fd43-4ce6-9391-a6113d2bffd7 req-04b5badd-0aa2-4dae-bf7c-ccaf82551b55 tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 921.243763] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 921.244091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.244213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.244285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.244481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.244634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.244730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.244791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.245017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.245017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.245123] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.646028] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.646028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.646028] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.646691] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.646937] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.647300] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.647566] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.647892] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.648835] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.648835] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.648835] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.648835] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.648835] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.648835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.650722] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.650722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.650722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.650722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.651847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.651961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.652038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.652197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.652301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.652391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.652545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.652636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.652694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.653469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.653469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.653710] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.678535] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.678770] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.678947] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.679132] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-988" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.679481] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-7fcc1891-6241-4089-b8f9-78868cb43d2c taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.679657] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.679811] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.680199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.680436] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fcc1891-6241-4089-b8f9-78868cb43d2c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.747038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.747038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.747038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.747290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.783636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.783750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.783841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.783917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.784126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.784206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.784294] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 921.813524] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.813633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.813791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.814093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.814940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.824784] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 922.086395] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 922.086679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.087043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.087043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.089031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.089031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.089031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.089031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.089031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.089031] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.160811] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9: rpc.has_security_group_logging(os_id): False [ 922.181021] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.181218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.181291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.181512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.181622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.181847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.181963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.182043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.182213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.182292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.182468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.182563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.182623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.182770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.182851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.183038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.183207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.183274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.183425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.183507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.183638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 is going to be created. [ 922.185120] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.185368] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.185500] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.185720] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.185859] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.186041] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 7fcc1891-6241-4089-b8f9-78868cb43d2c not found, creating... [ 922.186336] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.186510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.186630] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.186849] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.186993] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.190517] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.190517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.190517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.190517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.190517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.190517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 7fcc1891-6241-4089-b8f9-78868cb43d2c is going to be created. [ 922.212251] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.212562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.212694] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.212989] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.213250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.213544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.375171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.375365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.375466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.375984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.375984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.409805] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: IN_PROGRESS for 2s [ 922.591993] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [req-4be20ca4-fd43-4ce6-9391-a6113d2bffd7 req-a29c6a2f-d78f-4162-8de3-c33cbc870e66 service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [req-4be20ca4-fd43-4ce6-9391-a6113d2bffd7 req-a29c6a2f-d78f-4162-8de3-c33cbc870e66 service nova] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [req-4be20ca4-fd43-4ce6-9391-a6113d2bffd7 req-a29c6a2f-d78f-4162-8de3-c33cbc870e66 service nova] Enqueued Resource ID: 7fcc1891-6241-4089-b8f9-78868cb43d2c with Priority: HIGHEST for action port [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_rules [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 922.988020] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcc1891-6241-4089-b8f9-78868cb43d2c with Priority: HIGHEST for action port [ 922.988020] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.988691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.988983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.989289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.989512] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.991264] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.993016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.993016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fcc1891-6241-4089-b8f9-78868cb43d2c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.993016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.993016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.993016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.993016] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fcc1891-6241-4089-b8f9-78868cb43d2c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.014496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 923.014496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.014496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.014496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.014496] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.094636] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.374958] env[65455]: INFO networking_nsxv3.common.synchronization [req-66a76c12-5dd0-4611-9952-8d09b1b1a089 req-7fd6d692-8a14-422d-ab77-423d01dc0aae tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 923.375627] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 923.376617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.376617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.376617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.378992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.378992] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.378992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.378992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.378992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.378992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.378992] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.494742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.494906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.496498] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fcc1891-6241-4089-b8f9-78868cb43d2c with status ACTIVE [ 923.496498] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.496721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.496721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.496896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.496984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.497179] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.497280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.497343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.497534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.497629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.497820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.497910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.497971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.498559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.498559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.498559] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fcc1891-6241-4089-b8f9-78868cb43d2c is going to be updated. [ 923.518950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.518950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.518950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.518950] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.540839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.541011] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.541088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.541322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.541467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.541646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fcc1891-6241-4089-b8f9-78868cb43d2c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.598882] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.598882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.598882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.598882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.598882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.598882] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be updated. [ 923.646156] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.646346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.646915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.646915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.646915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.658570] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 923.836024] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 923.836229] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 deletion is rescheduled due to dependency. [ 923.836372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.836580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.836815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.837473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.837473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.837473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.837473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.837473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.837707] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.880603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.880776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.880869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.881417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.881417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.881417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.881592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.881592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.882641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.882715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.884390] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 923.923243] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.923461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.923461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.923663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.923807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.933548] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 924.022597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.023302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.023302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.023302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.023302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.023910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.023910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.023910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.023910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.023910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.024147] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.024147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.024261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.024380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.025039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.025039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.025039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.025039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.025039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.025039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.025039] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.343104] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.422751] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: SUCCESS [ 924.422975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.527863] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c376506d-a918-477c-96df-60ae10c0bcb8: rpc.has_security_group_logging(os_id): False [ 924.547746] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.547902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.547990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.548272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.548372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.548774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.548905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.548975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.549162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.549245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.549440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.549540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.549605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.549754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.549838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.550032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.550129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.550191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.550331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.550404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.550489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 924.613875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.614136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.614136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.614345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.614492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.627611] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 924.845897] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.348801] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.348801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.349216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.349216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.349216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.349325] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 925.406052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.406052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.406052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.406437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.406966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.420516] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 925.670163] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 925.670398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.670575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.670814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.671014] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.671142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.671208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.671381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.671458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.671545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.671635] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.947779] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 925.947779] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 925.947779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.174854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.174854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.174854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.174854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.174854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.175169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.175169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.175169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.175268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.175268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.175457] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.175580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.175643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.175797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.175937] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.176040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.176101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.176241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.176316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.176396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.176485] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.641847] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 926.642076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.680071] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a86ef01d-dc8d-4d53-89c0-62ea8aeb7720: rpc.has_security_group_logging(os_id): False [ 926.699276] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.699425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.699495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.699715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.722516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.722805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.722933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.723009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.723240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.723321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.723537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.723641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.723706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.723859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.723936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.724153] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.724250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.724310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.724453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.724527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.724611] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be updated. [ 926.808298] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.808499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.808550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.808753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.808902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.824818] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 927.432627] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 927.432744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.432985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.433260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.433483] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.433604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.434940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.434940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.434940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.434940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.434940] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.936734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.938117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.938117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.938389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.938389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.938593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.938671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.938757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.938996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.939159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.939910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.939910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.939910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.939910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.939910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.940082] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.377778] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 928.377778] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 928.442619] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5: rpc.has_security_group_logging(os_id): False [ 928.464414] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.464627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.464704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.464918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.465176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.465770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.465899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.465964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.466201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.466316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.466504] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.466743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.466833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.466980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.467058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.467259] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.467350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.467415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.467610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.467696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.467791] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 928.593887] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.593887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.593887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.593887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.593887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.627407] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 928.840477] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 928.840724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.092593] env[65455]: INFO networking_nsxv3.common.synchronization [req-da137b70-a033-4061-b7b6-de50d4a2d4d6 req-2b54b059-4445-4b99-8582-60efe2c67a11 tempest-ServersTestManualDisk-393770702 tempest-ServersTestManualDisk-393770702-project-member] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 929.094445] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGHEST for action security_group_members [ 929.095412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.095412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.095412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.095412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.095652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.095753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.095841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.096059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.096182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.096483] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.601774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.601969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.602212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.602265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.604497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.604497] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.604497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.604497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.604497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.604497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.604497] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 is going to be updated. [ 929.639904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.641151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.641151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.641151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.641151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.652397] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: IN_PROGRESS for 2s [ 930.014404] env[65455]: INFO networking_nsxv3.common.synchronization [req-30118621-6ef5-41b4-ae11-ed0f4642e564 req-6c88d2f7-6a01-4282-a5de-dfcb6209c118 tempest-ServersNegativeTestMultiTenantJSON-1539234573 tempest-ServersNegativeTestMultiTenantJSON-1539234573-project-member] Enqueued Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 930.014977] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGHEST for action security_group_members [ 930.015334] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.016328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.016328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.016328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.016328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.016328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.016328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.016620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.016620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.016620] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.520165] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.520508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.520508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.521239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.521239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.521239] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.521239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.521239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.521239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.521454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.521454] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 is going to be updated. [ 930.551432] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.551432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.551432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.551432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.551698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.563174] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: IN_PROGRESS for 2s [ 930.644688] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 930.644908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.664500] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 in Status: SUCCESS [ 931.664979] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 deletion is rescheduled due to dependency. [ 931.665062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.573355] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 in Status: SUCCESS [ 932.573541] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 deletion is rescheduled due to dependency. [ 932.573653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.016671] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.016671] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 935.520145] env[65455]: INFO networking_nsxv3.common.synchronization [req-cb87ab9e-c904-4df7-8814-204f507b6847 req-68761c2e-72be-4d2f-803b-68942895436e tempest-ImagesOneServerNegativeTestJSON-2110101679 tempest-ImagesOneServerNegativeTestJSON-2110101679-project-member] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 935.520266] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGHEST for action security_group_members [ 935.521115] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.521253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.521312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.521482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.521625] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.522177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.522177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.522177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.522177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.522177] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.024905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.025353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.025353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.025692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.025839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.026224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.026404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.026521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.026821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.026965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.027139] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be updated. [ 936.073762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.074102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.074102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.074253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.074380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.086913] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: IN_PROGRESS for 2s [ 938.099482] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 in Status: SUCCESS [ 938.100624] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 deletion is rescheduled due to dependency. [ 938.100624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.522653] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 940.522653] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 940.614741] env[65455]: INFO networking_nsxv3.common.synchronization [req-83ae22f2-65ce-40be-839b-b85346b2bfc2 req-e60bf3e1-387d-4f3e-941f-b96fe231e6f2 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 940.616526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 940.616526] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.616526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.616526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.616763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.616796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.617038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.617038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.617144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.617177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.618377] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.119278] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.421412] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef4ff714-2138-4a1f-ae7c-70592be86feb req-4c86719b-72a9-47ed-a5f1-fd72d563389c tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 941.425105] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 941.425840] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.426039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.426124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.426349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.426933] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.426933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.426933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.426933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.426933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.427191] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.622274] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.808811] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.809067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.809197] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.809467] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.809736] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.809897] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.810070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.810277] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.810426] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.810638] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.810752] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.810866] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.810971] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.811093] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.811198] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.811326] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.832664] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.832871] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.832950] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.833147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.833468] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-5d232dcd-9412-4fcd-86a5-890ad0d638be taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.833638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.833758] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.834172] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.834311] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d232dcd-9412-4fcd-86a5-890ad0d638be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.930197] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.930371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.930423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.930648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.930738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.930939] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.931152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.931152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.931264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.931339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.931425] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 941.957095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.957241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.957293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.957478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.957619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.968533] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 942.124317] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.124563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.125143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.125143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.125143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.125300] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be updated. [ 942.153801] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.154023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.154023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.154348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.154528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.162749] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 942.336829] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.337169] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.337310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.337629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.337802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.338023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 5d232dcd-9412-4fcd-86a5-890ad0d638be not found, creating... [ 942.338429] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.338700] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.338853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.339197] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.339406] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.339801] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.340022] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.340193] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.340498] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.340890] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.341160] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 5d232dcd-9412-4fcd-86a5-890ad0d638be is going to be created. [ 942.366830] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.367450] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.367539] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.368017] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.368515] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.368941] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.086285] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef4ff714-2138-4a1f-ae7c-70592be86feb req-6b8e26af-21d9-4a40-ac3c-85ef56c8705e service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 943.086285] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef4ff714-2138-4a1f-ae7c-70592be86feb req-6b8e26af-21d9-4a40-ac3c-85ef56c8705e service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 943.086285] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef4ff714-2138-4a1f-ae7c-70592be86feb req-6b8e26af-21d9-4a40-ac3c-85ef56c8705e service nova] Enqueued Resource ID: 5d232dcd-9412-4fcd-86a5-890ad0d638be with Priority: HIGHEST for action port [ 943.087273] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 943.087616] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 943.088132] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d232dcd-9412-4fcd-86a5-890ad0d638be with Priority: HIGHEST for action port [ 943.088532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.088844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.089017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.089363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.089533] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.090750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.091063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.091478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d232dcd-9412-4fcd-86a5-890ad0d638be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.091801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.091989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.092484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.093711] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d232dcd-9412-4fcd-86a5-890ad0d638be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.594158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.594565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.594565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d232dcd-9412-4fcd-86a5-890ad0d638be with status ACTIVE [ 943.594864] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.594864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.594995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.595124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.595246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.595394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.595492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.595550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.595813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.595892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.598050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.598050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.598050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.598050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.598050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.598050] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d232dcd-9412-4fcd-86a5-890ad0d638be is going to be updated. [ 943.619682] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.619682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.619815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.620435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.620435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.620435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d232dcd-9412-4fcd-86a5-890ad0d638be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.978955] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 943.979169] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 943.979287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.979457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.979677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.979859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.979972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.980059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.980246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.980332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.980421] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.174835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 944.175225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.484883] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.988751] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.492063] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.492417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.492417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.492541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.492633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.492734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 945.532404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.532596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.532596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.532756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.532891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.542478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 945.931820] env[65455]: INFO networking_nsxv3.common.synchronization [req-7adb6dc2-17b4-4500-97f3-c3d8e7a121d1 req-d9ef0c85-9cc8-4672-8b6d-36c2490811ab tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 945.932359] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 945.932660] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.932783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.932858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.933122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.933290] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.933381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.933458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.933612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.933740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.933826] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.256708] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.256924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.257077] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.257360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.258950] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.260061] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.260061] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.260061] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.260061] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.260345] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.260447] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.260556] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.260662] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.260768] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 946.260871] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.261119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.286927] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.287191] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 946.287342] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.287518] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.287931] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.288162] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.288342] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.288776] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.288934] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0155bdd-aad7-4fb2-be18-c73ed0f34cfe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.436355] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.793708] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.794130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.794130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.794446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.794689] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.795026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port e0155bdd-aad7-4fb2-be18-c73ed0f34cfe not found, creating... [ 946.795165] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.795330] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.795446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.795687] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.795864] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.796185] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.796343] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.796483] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.796759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.796908] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.797097] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: e0155bdd-aad7-4fb2-be18-c73ed0f34cfe is going to be created. [ 946.820310] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.820615] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.820801] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.821363] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.821817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.822293] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.939620] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.442338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.443357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.445178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.445178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.445178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.445178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 947.492581] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.493962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.493962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.493962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.493962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.505885] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 947.509921] env[65455]: INFO networking_nsxv3.common.synchronization [req-f04a1372-1f58-4344-a67c-e1b6983b218f req-9345ac46-3cb8-4cf3-8757-004ed510fb4b tempest-ServerRescueTestJSON-1796748323 tempest-ServerRescueTestJSON-1796748323-project-member] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 947.510464] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 947.510770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.510894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.510984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.511208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.511352] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.511446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.511508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.511651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.511734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.511821] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.541310] env[65455]: INFO networking_nsxv3.common.synchronization [req-7adb6dc2-17b4-4500-97f3-c3d8e7a121d1 req-fc5b26f2-2f91-4e02-9d14-e52de83d21da service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 947.541508] env[65455]: INFO networking_nsxv3.common.synchronization [req-7adb6dc2-17b4-4500-97f3-c3d8e7a121d1 req-fc5b26f2-2f91-4e02-9d14-e52de83d21da service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 947.541652] env[65455]: INFO networking_nsxv3.common.synchronization [req-7adb6dc2-17b4-4500-97f3-c3d8e7a121d1 req-fc5b26f2-2f91-4e02-9d14-e52de83d21da service nova] Enqueued Resource ID: e0155bdd-aad7-4fb2-be18-c73ed0f34cfe with Priority: HIGHEST for action port [ 947.542177] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 947.542324] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 947.542422] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0155bdd-aad7-4fb2-be18-c73ed0f34cfe with Priority: HIGHEST for action port [ 947.543467] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.543643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.543734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.543967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.544105] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.545973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.545973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.545973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.545973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.546244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.547642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.547642] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0155bdd-aad7-4fb2-be18-c73ed0f34cfe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.557362] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 947.557803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.557933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.558225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.558458] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.558621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.558711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.558949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.560347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.560513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.560722] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.013718] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.049899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.050899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.050899] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0155bdd-aad7-4fb2-be18-c73ed0f34cfe with status ACTIVE [ 948.051090] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.051090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.051233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.051370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.051478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.051665] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.051761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.051826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.052917] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.052917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.052917] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0155bdd-aad7-4fb2-be18-c73ed0f34cfe is going to be updated. [ 948.063363] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.063363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.063363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.063363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.063577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.063628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.063658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.063918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.063918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.064030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.064523] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.064523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.064523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.064523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.064667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.064727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.064766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.064949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.064998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.065056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.065185] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.075628] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.075847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.075847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.076114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.076269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.076453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0155bdd-aad7-4fb2-be18-c73ed0f34cfe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.143174] env[65455]: INFO networking_nsxv3.common.synchronization [None req-57926a84-778f-431e-8ddf-b95a95e186c3 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 948.143434] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 948.143843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.143921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.143983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.144220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.144309] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.259760] env[65455]: INFO networking_nsxv3.common.synchronization [None req-b77c3831-5e44-4cc7-b57f-ab348b954b80 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 948.260526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 948.261367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.261367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.486979] env[65455]: INFO networking_nsxv3.common.synchronization [req-f536e6aa-6491-413a-95a7-8aba15b877fa req-444f5f3a-ae33-4f99-95b3-af5eeda4105a tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 948.488012] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 948.488192] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.488333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.488404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.488671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.492201] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.492294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.492333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.492497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.492586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.492682] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.516082] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.567716] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de94ae8c-64b4-4119-bf51-89a5595f402a: rpc.has_security_group_logging(os_id): False [ 948.586461] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.586690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.586760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.587148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.587148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.587372] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.587493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.587584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.587808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.587915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.588140] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.588241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.588302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.588438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.588510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.588683] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.588788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.588858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.589095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.589168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.589274] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 948.669033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.669033] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 already deleted. [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.669033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.669033] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.671138] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.671518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.671717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.672024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.672332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.688445] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 948.845208] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.845208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.845208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.845502] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.846114] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.846298] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.846418] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.846673] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.846786] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.847119] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.847119] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.847239] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.847338] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.847468] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.847607] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.847754] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.868341] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.868512] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.868652] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.868853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.869245] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-513d41bc-8a90-4c39-b15f-300ec148b4d1 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.869429] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.869546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.870245] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.870393] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513d41bc-8a90-4c39-b15f-300ec148b4d1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.997095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.997265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.997336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.997549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.997642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.998230] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.998230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.998230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.998230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.998433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.998433] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 already deleted. [ 948.998433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.020093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.020093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.020093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.020093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.020093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.020093] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be updated. [ 949.094484] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.094484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.094484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.094484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.094484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.106035] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 949.208734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.208734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.208906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.209287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.209287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.209287] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 already deleted. [ 949.209287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.373469] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.373736] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.373858] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.375244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.375244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.375244] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 513d41bc-8a90-4c39-b15f-300ec148b4d1 not found, creating... [ 949.375244] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.375244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.375244] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.375513] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.375603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.375958] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.376141] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.376281] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.376471] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.376606] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.376774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 is going to be created. [ 949.400839] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.401097] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.401250] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.401496] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.401723] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.401964] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.517200] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 949.517433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.517613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.517925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.518144] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.518939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.518939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.518939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.518939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.518939] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.022188] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.120952] env[65455]: INFO networking_nsxv3.common.synchronization [req-f536e6aa-6491-413a-95a7-8aba15b877fa req-190d1466-8f70-40bc-9a50-62d360fb70b4 service nova] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 950.120952] env[65455]: INFO networking_nsxv3.common.synchronization [req-f536e6aa-6491-413a-95a7-8aba15b877fa req-190d1466-8f70-40bc-9a50-62d360fb70b4 service nova] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 950.120952] env[65455]: INFO networking_nsxv3.common.synchronization [req-f536e6aa-6491-413a-95a7-8aba15b877fa req-190d1466-8f70-40bc-9a50-62d360fb70b4 service nova] Enqueued Resource ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 with Priority: HIGHEST for action port [ 950.121437] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 950.121437] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 950.121603] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 with Priority: HIGHEST for action port [ 950.121742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.121869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.121953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.123184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.123184] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.125429] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.125526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.125754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.126011] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.126191] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.126606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.126749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.126848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.126939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.127986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.130357] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-513d41bc-8a90-4c39-b15f-300ec148b4d1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.130357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.130357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.130640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.130640] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513d41bc-8a90-4c39-b15f-300ec148b4d1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.526390] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.634945] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 513d41bc-8a90-4c39-b15f-300ec148b4d1 with status ACTIVE [ 950.634945] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.634945] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.634945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.635409] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.635453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.635520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.638314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.638314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.638465] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 is going to be updated. [ 950.640074] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.641172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.641286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.680032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.680222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.680286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.680480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.680633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.680806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.714095] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 950.714334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.919873] env[65455]: INFO networking_nsxv3.common.synchronization [req-7447a359-95e9-41ff-8695-2ab5ade57f5d req-154a74db-5b86-49a4-9ec4-9d50898a889a tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 950.920476] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 950.921041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.921041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.921204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.921923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.921923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.921923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.921923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.921923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.921923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.921923] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.029600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.029996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.029996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.030122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.030166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.030285] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 951.063688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.063688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.063688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.063897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.063897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.078191] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 951.117288] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 951.117288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.144105] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.259191] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.259333] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.259512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.259832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.260174] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.260404] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.260556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.260808] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.260984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.261239] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.261356] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.261549] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.261758] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.261901] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.262038] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.262186] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.307532] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.307816] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.307978] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.308267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.308518] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-f7bb2c4a-657b-4d46-bb07-b6442e925579 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.308699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.308827] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.309299] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.309457] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7bb2c4a-657b-4d46-bb07-b6442e925579',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.424342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.424536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.424619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.424823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.424918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.425134] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.425228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.425293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.425438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.425514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.425599] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 951.455337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.455582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.455582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.455820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.455903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.471529] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 951.647033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.647166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.647278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.647656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.647656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.647743] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 is going to be created. [ 951.672560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.672790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.672790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.673029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.673244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.684995] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: UNINITIALIZED for 2s [ 951.812056] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.812577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.812577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.812924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.813083] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.813268] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port f7bb2c4a-657b-4d46-bb07-b6442e925579 not found, creating... [ 951.813602] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813873] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813942] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.814331] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.814426] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.814760] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.814984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.815129] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.815527] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.815527] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.815738] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: f7bb2c4a-657b-4d46-bb07-b6442e925579 is going to be created. [ 951.841812] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.841812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.841812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.841812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.841812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.841812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.588725] env[65455]: INFO networking_nsxv3.common.synchronization [req-7447a359-95e9-41ff-8695-2ab5ade57f5d req-ccc6852d-3af4-4ef5-8175-2e639f2deeb7 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 952.588725] env[65455]: INFO networking_nsxv3.common.synchronization [req-7447a359-95e9-41ff-8695-2ab5ade57f5d req-ccc6852d-3af4-4ef5-8175-2e639f2deeb7 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 952.589025] env[65455]: INFO networking_nsxv3.common.synchronization [req-7447a359-95e9-41ff-8695-2ab5ade57f5d req-ccc6852d-3af4-4ef5-8175-2e639f2deeb7 service nova] Enqueued Resource ID: f7bb2c4a-657b-4d46-bb07-b6442e925579 with Priority: HIGHEST for action port [ 952.589326] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 952.589474] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 952.589562] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7bb2c4a-657b-4d46-bb07-b6442e925579 with Priority: HIGHEST for action port [ 952.589937] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.589937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.590166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.590215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.590304] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.591140] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.591305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.592231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7bb2c4a-657b-4d46-bb07-b6442e925579 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.592231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.592231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.592231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.592231] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7bb2c4a-657b-4d46-bb07-b6442e925579',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.090853] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 953.091727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.091727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.091727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.091727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.091979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.091979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.092078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.092173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.092270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.092366] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.093675] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.093814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.097200] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7bb2c4a-657b-4d46-bb07-b6442e925579 with status ACTIVE [ 953.097870] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.097870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.098034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.098262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.098417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.098746] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.098938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.099059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.099326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.099472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.100329] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.104074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.104320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.104653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.105013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.105082] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7bb2c4a-657b-4d46-bb07-b6442e925579 is going to be updated. [ 953.134596] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.134830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.135025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.135373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.135517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.135690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7bb2c4a-657b-4d46-bb07-b6442e925579" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.484460] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 953.484645] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 953.484765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.484937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.485263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.485454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.485576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.485658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.485804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.485946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.486054] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.541690] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f2d0acc-985e-4450-9141-837ec4080757 req-975d137c-d9fc-4f2e-8303-d38acb0e83ba tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 953.542704] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 953.543363] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.543363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.543363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.543363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.543604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.543604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.543685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.543828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.543917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.544523] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.595961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.596326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.596326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.596694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.596694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.596694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.596921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.596921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.597027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.597321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.597489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.597584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.597645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.598440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.598440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.598440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.598440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.598440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.598754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.598754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.598754] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.702126] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: SUCCESS [ 953.702440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.702527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.702717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.702968] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.703133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.703200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.703362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.703493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.703589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.703623] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.868928] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-337 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.869235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.869431] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.869708] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.869969] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.870150] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.870306] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.870613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.870815] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.871046] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.871168] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 953.871278] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 953.871384] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 953.871493] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 953.871619] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 953.871733] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 953.891950] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 953.891950] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 953.891950] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 953.891950] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-337" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.891950] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-3b482272-651c-41e5-ac6a-008542034a62 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.892170] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.892213] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.892517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.892656] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b482272-651c-41e5-ac6a-008542034a62',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.988029] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.045983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.046221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.046291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.046485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.046611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.046818] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.047018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.047091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.047261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.047337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.047424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 954.073796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.073928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.073962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.074183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.074784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.082772] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 954.100494] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 954.119089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.119278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.119349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.119558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.119648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.119874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.119970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.120054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.120207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.120282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.120455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.120548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.120608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.120793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.120830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.120975] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.121125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.121125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.121259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.121330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.121442] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 954.207433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.207642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.207642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.207894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.208065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.209193] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.226866] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 954.395754] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.397257] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.397421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.397638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.397799] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.397984] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 3b482272-651c-41e5-ac6a-008542034a62 not found, creating... [ 954.398322] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.398507] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.398632] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.399045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.399172] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.399478] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.399656] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.399770] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.400087] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.400340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.400340] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 3b482272-651c-41e5-ac6a-008542034a62 is going to be created. [ 954.425420] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.425727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.425927] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.426318] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.426732] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.427054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.491169] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.711534] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f01b182-5b01-4e49-8f70-13d804029019: rpc.has_security_group_logging(os_id): False [ 954.740992] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.741353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.741492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.745037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.745037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.745037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.745037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.745037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.745839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.745982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.746185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 is going to be created. [ 954.833202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.833424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.833424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.833613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.833936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.850097] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: IN_PROGRESS for 2s [ 954.994573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.994803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.994877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.995108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.995198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.995303] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 955.023497] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.023690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.023759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.023976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.024153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.036531] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 955.138881] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f2d0acc-985e-4450-9141-837ec4080757 req-ee3db8e2-be60-43dd-93be-3191622ffd9a service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 955.139148] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f2d0acc-985e-4450-9141-837ec4080757 req-ee3db8e2-be60-43dd-93be-3191622ffd9a service nova] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 955.139297] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f2d0acc-985e-4450-9141-837ec4080757 req-ee3db8e2-be60-43dd-93be-3191622ffd9a service nova] Enqueued Resource ID: 3b482272-651c-41e5-ac6a-008542034a62 with Priority: HIGHEST for action port [ 955.139844] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_rules [ 955.140029] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 955.140191] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b482272-651c-41e5-ac6a-008542034a62 with Priority: HIGHEST for action port [ 955.140544] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.140741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.140848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.141046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.141132] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.142114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.142114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.142263] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b482272-651c-41e5-ac6a-008542034a62 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.142361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.142456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.142999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.143064] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b482272-651c-41e5-ac6a-008542034a62',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.647667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.647667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.647822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b482272-651c-41e5-ac6a-008542034a62 with status ACTIVE [ 955.648125] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.648278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.648457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.648750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.648965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.649243] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.649423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.649517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.649813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.649990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.650345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.650512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.650599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.650765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.650863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.651025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b482272-651c-41e5-ac6a-008542034a62 is going to be updated. [ 955.679460] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.679663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.679762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.680079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.680259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.680459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b482272-651c-41e5-ac6a-008542034a62" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.096031] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 956.096031] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 956.096031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.096031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.096031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.096549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.096549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.096549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.096549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.096549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.096720] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.240568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 956.240812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.599469] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.865565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: SUCCESS [ 956.865565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.049621] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 957.049956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.050161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.050511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.050836] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.051069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.051158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.051382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.051525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.051674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.051846] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.102839] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.554155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.554296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.554367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.554583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.554750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.554861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.554927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.555073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.555157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.555275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.555429] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.555489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.555551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.555704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.555847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.555973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.556119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.556211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.556289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.556391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.556484] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.604828] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.604985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.605075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.605296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.605387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.605484] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 957.638820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.638924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.638966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.639193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.639349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.649225] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 958.058997] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 958.069314] env[65455]: INFO networking_nsxv3.common.synchronization [req-efbf0c94-c0ca-4471-bfee-3ca200615745 req-e964e229-00e1-4d7b-908f-bf96aea863a1 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 958.070525] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 958.070525] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.070525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.070525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.070771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.070771] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.070771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.070882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.070976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.071288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.071393] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.077956] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.078143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.078212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.078386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.078711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.078711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.078871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.078871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.078983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.079098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.079286] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.079378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.079464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.079578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.079647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.079867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.079978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.079978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.084088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.084191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.084297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 958.174735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.175071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.175071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.175186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.175263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.195135] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 958.488241] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.492327] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.492327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.492327] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.492327] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.492327] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.492327] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.492327] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.492327] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.492327] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.518573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.518841] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.518967] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.519107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.519844] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-6575761c-bee9-4c76-8930-cbcd4b5360c7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.519844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.519844] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.521684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.521684] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6575761c-bee9-4c76-8930-cbcd4b5360c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.573391] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.024285] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.024569] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.024700] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.025165] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.025331] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.025539] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 6575761c-bee9-4c76-8930-cbcd4b5360c7 not found, creating... [ 959.025874] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.026066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.026216] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.026485] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.026662] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.028104] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.028422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.028503] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.028758] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.028996] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.029237] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 6575761c-bee9-4c76-8930-cbcd4b5360c7 is going to be created. [ 959.050922] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.051189] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.051322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.051627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.051920] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.052195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.075873] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.578657] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.578944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.578944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.579599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.579599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.579599] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 959.598476] env[65455]: INFO networking_nsxv3.common.synchronization [req-0d3c188d-b2e4-48c1-9879-ae80ad6af003 req-e5cb50c3-345f-42ee-abf0-390ef94ca88c tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 959.599046] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 959.599452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.599585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.599656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.599857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.600018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.600114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.600178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.600328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.600411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.600559] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.607368] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.607500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.607562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.607741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.607879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.617798] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 959.659792] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 959.660078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.660276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.660502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.660713] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.661286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.661419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.661630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.661747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.661850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.661946] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.766843] env[65455]: INFO networking_nsxv3.common.synchronization [req-efbf0c94-c0ca-4471-bfee-3ca200615745 req-c3be6968-b3e3-4ac7-8055-51526f690b8f service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 959.766843] env[65455]: INFO networking_nsxv3.common.synchronization [req-efbf0c94-c0ca-4471-bfee-3ca200615745 req-c3be6968-b3e3-4ac7-8055-51526f690b8f service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 959.766843] env[65455]: INFO networking_nsxv3.common.synchronization [req-efbf0c94-c0ca-4471-bfee-3ca200615745 req-c3be6968-b3e3-4ac7-8055-51526f690b8f service nova] Enqueued Resource ID: 6575761c-bee9-4c76-8930-cbcd4b5360c7 with Priority: HIGHEST for action port [ 959.766843] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 959.766843] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 959.767267] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6575761c-bee9-4c76-8930-cbcd4b5360c7 with Priority: HIGHEST for action port [ 959.770051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.770051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.770051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.770051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.770051] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.770051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.770612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.770612] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6575761c-bee9-4c76-8930-cbcd4b5360c7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.770612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.770802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.770960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.772109] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6575761c-bee9-4c76-8930-cbcd4b5360c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.103759] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.165563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.165563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.165563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.165563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.165563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.167028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.167028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.167028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.167028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.167028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.167028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.167496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.169134] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.169134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.169960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.169960] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.210159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 960.210468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.270595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.270595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.275042] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6575761c-bee9-4c76-8930-cbcd4b5360c7 with status ACTIVE [ 960.275042] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.275042] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.275042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.275705] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.275705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.275705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.275705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.275705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.276099] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6575761c-bee9-4c76-8930-cbcd4b5360c7 is going to be updated. [ 960.310664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.310854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.310928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.311158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.311443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.311510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6575761c-bee9-4c76-8930-cbcd4b5360c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.605520] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.674480] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6fe6dc0e-8a36-4463-aa2a-12b94566760c: rpc.has_security_group_logging(os_id): False [ 960.696777] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.696937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.697013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.697240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.697338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.697559] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.697658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.697719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.697869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.697959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.698173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.698273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.698335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.698475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.698548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.698732] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.698824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.698885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.699072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.699151] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.699237] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 960.778136] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.778286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.778363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.778574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.778720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.801238] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 961.108327] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.108440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.108509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.108732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.108819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.108954] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 961.151572] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.151572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.151572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.151572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.151572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.175584] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 961.634105] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 961.634105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.634398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.634487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.634671] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.634834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.634892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.635069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.635136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.635236] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.139478] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.644975] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.818603] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 962.820216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.148821] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.149086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.149222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.149459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.149616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.149676] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 963.183402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.183402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.183402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.183698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.183742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.189293] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 963.189509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.191666] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 964.768062] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 964.768381] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 965.205152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.205152] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.205152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.205152] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.711275] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.711638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.711766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.712135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.712471] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.712674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.712809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.713234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.713457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.714014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.714134] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.714510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.714806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.715598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.715598] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.715812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.716035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.716436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.716945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.717373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.717646] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.055888] env[65455]: INFO networking_nsxv3.common.synchronization [None req-3349e2cd-8667-484a-88bb-a2c1f4626505 None None] Enqueued Resource ID: 9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e with Priority: HIGHEST for action port [ 966.056878] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e with Priority: HIGHEST for action port [ 966.057220] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.058391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.058391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.058391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.059039] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.222652] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c376506d-a918-477c-96df-60ae10c0bcb8: rpc.has_security_group_logging(os_id): False [ 966.242458] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.242637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.242684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.242879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.242966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.243217] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.243322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.243375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.243531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.243610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.243857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.243962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.244047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.244520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.244520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.244520] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.244520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.244712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.244712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.244783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.244858] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 966.333147] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.333348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.333407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.333843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.334045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.350674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 966.561415] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e [ 966.561741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.561897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.561964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.562216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.562321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.562419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e already deleted. [ 966.562511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fb8a9c9-f02f-42e7-b2b4-dc960833eb4e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.584878] env[65455]: INFO networking_nsxv3.common.synchronization [req-1de326c1-9f4e-41a6-aea2-b811a58b4cc4 req-9e9ce83d-92e8-4688-a6c5-744646a19dbb tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 966.585494] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 966.585838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.586024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.586213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.586453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.587515] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.587515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.587515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.587515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.587515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.587515] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.090127] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.093030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.093030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.093030] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 967.126728] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.126832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.126933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.127131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.130107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.137826] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 967.520405] env[65455]: INFO networking_nsxv3.common.synchronization [None req-bc12b6eb-cd11-4491-b3ce-baf505549351 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 967.520405] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 967.520743] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.520890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.521244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.522611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.522611] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.651269] env[65455]: INFO networking_nsxv3.common.synchronization [None req-041360eb-4a64-4c1b-9def-19dfb7650e1b tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 967.651269] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 967.651350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.651809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.046765] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.046969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.046969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.047118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.047910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.048059] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 already deleted. [ 968.048165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.048524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.048524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.048628] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.367519] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 968.367726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.518469] env[65455]: INFO networking_nsxv3.common.synchronization [None req-62b22b41-cd11-4490-92fa-3ed1ffe01c47 None None] Enqueued Resource ID: a9c2de2b-943d-4bbe-80bf-c3cd874004c5 with Priority: HIGHEST for action port [ 968.519605] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c2de2b-943d-4bbe-80bf-c3cd874004c5 with Priority: HIGHEST for action port [ 968.519985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c2de2b-943d-4bbe-80bf-c3cd874004c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.520149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c2de2b-943d-4bbe-80bf-c3cd874004c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.520213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c2de2b-943d-4bbe-80bf-c3cd874004c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.520448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c2de2b-943d-4bbe-80bf-c3cd874004c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.520524] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c2de2b-943d-4bbe-80bf-c3cd874004c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.677789] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9c2de2b-943d-4bbe-80bf-c3cd874004c5 [ 968.679770] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.679770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.679770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.679770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.679770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.679770] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9c2de2b-943d-4bbe-80bf-c3cd874004c5 already deleted. [ 968.679770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c2de2b-943d-4bbe-80bf-c3cd874004c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.700232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.700398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.700474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.700686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.700773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.700866] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 already deleted. [ 968.700945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.167442] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 969.167994] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 969.167994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.736977] env[65455]: INFO networking_nsxv3.common.synchronization [req-9d854550-df96-460f-89a4-92e5156e4770 req-114cda9d-009a-4b2f-b9b3-467aa3821073 tempest-ServersWithSpecificFlavorTestJSON-1121879236 tempest-ServersWithSpecificFlavorTestJSON-1121879236-project-member] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 971.737556] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGHEST for action security_group_members [ 971.737872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.738212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.738281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.738486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.738640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.738737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.738799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.738947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.739041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.739139] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.235892] env[65455]: INFO networking_nsxv3.common.synchronization [req-8147dc50-86d8-4caa-9469-0055d8fff3f6 req-abe75674-c95b-467d-b37f-070132b14147 tempest-MigrationsAdminTest-1784604315 tempest-MigrationsAdminTest-1784604315-project-member] Enqueued Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 972.236342] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c4ff11-5e8b-4540-903a-abb548417d57 with Priority: HIGHEST for action security_group_members [ 972.236673] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c4ff11-5e8b-4540-903a-abb548417d57 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.236792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.236853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.238026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.238270] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.238375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.238432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.238617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.238700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.238787] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c4ff11-5e8b-4540-903a-abb548417d57',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.241505] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.241505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.241505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.241720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.275857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.277503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.277503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.277503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.277503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.277730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.277730] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be updated. [ 972.315184] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.315333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.315401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.315650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.315814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.335838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: IN_PROGRESS for 2s [ 972.745213] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.745539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.745820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.746136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.767057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.767404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.767557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.767634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.767867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.767989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.768163] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 is going to be updated. [ 972.798262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.798262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.798262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.799115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.799480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.809692] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: IN_PROGRESS for 2s [ 974.247691] env[65455]: INFO networking_nsxv3.common.synchronization [None req-22da8a63-8ce1-45a1-8681-101a0a756028 None None] Enqueued Resource ID: e65d1692-7073-4efb-ace6-067c9bc36008 with Priority: HIGHEST for action port [ 974.248348] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e65d1692-7073-4efb-ace6-067c9bc36008 with Priority: HIGHEST for action port [ 974.248674] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e65d1692-7073-4efb-ace6-067c9bc36008 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.248800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e65d1692-7073-4efb-ace6-067c9bc36008" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.248865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e65d1692-7073-4efb-ace6-067c9bc36008" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.249357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e65d1692-7073-4efb-ace6-067c9bc36008" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.249473] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e65d1692-7073-4efb-ace6-067c9bc36008',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.347029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 in Status: SUCCESS [ 974.347029] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 deletion is rescheduled due to dependency. [ 974.347029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.754337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e65d1692-7073-4efb-ace6-067c9bc36008 [ 974.754337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.754337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.754337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.754337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.754337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.754337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e65d1692-7073-4efb-ace6-067c9bc36008 already deleted. [ 974.754337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e65d1692-7073-4efb-ace6-067c9bc36008" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.823060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c4ff11-5e8b-4540-903a-abb548417d57 in Status: SUCCESS [ 974.823407] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c4ff11-5e8b-4540-903a-abb548417d57 deletion is rescheduled due to dependency. [ 974.823586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c4ff11-5e8b-4540-903a-abb548417d57" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.073816] env[65455]: INFO networking_nsxv3.common.synchronization [req-b773be34-9432-4585-b218-126f0e7f957c req-84d8ebcc-f388-42ec-966d-4a1c106fd53e tempest-ServerRescueTestJSON-1796748323 tempest-ServerRescueTestJSON-1796748323-project-member] Enqueued Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 977.074109] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 with Priority: HIGHEST for action security_group_members [ 977.074369] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.074497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.078019] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.078019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.078019] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a86ef01d-dc8d-4d53-89c0-62ea8aeb7720',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.087649] env[65455]: INFO networking_nsxv3.common.synchronization [None req-24745c4f-7134-4805-8056-dc0ffe41e7b3 None None] Enqueued Resource ID: f99a3546-5e7b-47e9-9993-811f6fead2bd with Priority: HIGHEST for action port [ 977.087819] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f99a3546-5e7b-47e9-9993-811f6fead2bd with Priority: HIGHEST for action port [ 977.088226] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f99a3546-5e7b-47e9-9993-811f6fead2bd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.088559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f99a3546-5e7b-47e9-9993-811f6fead2bd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.088559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f99a3546-5e7b-47e9-9993-811f6fead2bd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.089030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f99a3546-5e7b-47e9-9993-811f6fead2bd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.089030] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f99a3546-5e7b-47e9-9993-811f6fead2bd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.174921] env[65455]: INFO networking_nsxv3.common.synchronization [req-a0ee8b61-a3ef-433f-8e3a-a07915e3ac9a req-809a00a3-529f-4ffc-a8b7-d155f582c214 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 977.175490] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 977.175812] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.175932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.175984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.176268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.176419] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.176522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.176583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.176740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.176826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.176910] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.578031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.578268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.578368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.578596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.579190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.579190] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.579190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.579190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.579685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.579685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.579685] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 is going to be updated. [ 977.593421] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f99a3546-5e7b-47e9-9993-811f6fead2bd [ 977.593687] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.593853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.593913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.594174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.594277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.594381] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f99a3546-5e7b-47e9-9993-811f6fead2bd already deleted. [ 977.594453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f99a3546-5e7b-47e9-9993-811f6fead2bd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.631028] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.631292] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.631446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.631927] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.632327] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.632477] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.632590] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.635131] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.635131] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.635131] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.635131] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.635131] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.635131] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.635131] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.635131] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.635131] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.636589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.636720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.636777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.637937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.637937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.648577] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: IN_PROGRESS for 2s [ 977.657731] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.658029] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.658343] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.658477] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-778" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.658914] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.659290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.659473] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.659921] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.660155] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.680083] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.680083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.680083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.680083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.680083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.680083] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.680787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.680787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.680787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.680787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.680787] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 already deleted. [ 977.680787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.888417] env[65455]: INFO networking_nsxv3.common.synchronization [req-6db0360c-3fc1-44b3-9e3f-0f0392325cfe req-78d74e61-a7bb-45e9-9421-b8092368ca5f tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 977.889090] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 977.889678] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.889678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.889904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.890224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.890469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.890615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.890725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.890940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.891079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.891222] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.170067] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.170067] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 not found, creating... [ 978.170067] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.170067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.170789] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.171028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.171281] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.171615] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.171864] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.172121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 is going to be created. [ 978.192372] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.192870] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.192870] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.193029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.193253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.193497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.392952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.393142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.393204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.393620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.415031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.415534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.415534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.415534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.415791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.415791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.415882] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 978.442906] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.443101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.443177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.443402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.443546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.455907] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 978.861152] env[65455]: INFO networking_nsxv3.common.synchronization [req-89956e8f-2304-4dbd-b659-56634515580a req-ee2c4b1a-1871-4fe5-bb42-568e100a37cf tempest-ImagesTestJSON-1477379533 tempest-ImagesTestJSON-1477379533-project-member] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 978.861733] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGHEST for action security_group_members [ 978.862059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.862186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.862273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.862453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.862607] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.862706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.862767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.862919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.863010] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.863213] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.957415] env[65455]: INFO networking_nsxv3.common.synchronization [req-a0ee8b61-a3ef-433f-8e3a-a07915e3ac9a req-1223ceb4-3a2d-4fe4-9def-ae970fbe7796 service nova] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 978.957601] env[65455]: INFO networking_nsxv3.common.synchronization [req-a0ee8b61-a3ef-433f-8e3a-a07915e3ac9a req-1223ceb4-3a2d-4fe4-9def-ae970fbe7796 service nova] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 978.958199] env[65455]: INFO networking_nsxv3.common.synchronization [req-a0ee8b61-a3ef-433f-8e3a-a07915e3ac9a req-1223ceb4-3a2d-4fe4-9def-ae970fbe7796 service nova] Enqueued Resource ID: 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 with Priority: HIGHEST for action port [ 978.958601] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_rules [ 978.958601] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 978.958601] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 with Priority: HIGHEST for action port [ 978.958845] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.958980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.959190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.959362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.959362] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.960203] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.960318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.960404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.960545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.960859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.960859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.960859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.961085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.961130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.961245] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.962426] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.962542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.962542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.962743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.962810] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.367577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.367892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.367892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.367955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.370034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.370034] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.370034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.370034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.370034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.370034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.370034] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be updated. [ 979.397748] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.397977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.398109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.398419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.399323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.409759] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: IN_PROGRESS for 2s [ 979.465532] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.466562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.466626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.466789] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 with status ACTIVE [ 979.466963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.467082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.467143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.467348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.467438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.467604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.467698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.467758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.467902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.467978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.468308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.468408] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.468471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.468618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.468692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.468776] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726 is going to be updated. [ 979.492738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.492958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.492992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.493253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.493443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.493600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4077b8b3-7ec2-4cc6-8ac4-0dcb13f71726" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.663561] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 in Status: SUCCESS [ 979.663768] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a86ef01d-dc8d-4d53-89c0-62ea8aeb7720 deletion is rescheduled due to dependency. [ 979.663889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a86ef01d-dc8d-4d53-89c0-62ea8aeb7720" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.971526] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.465374] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 980.465715] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef deletion is rescheduled due to dependency. [ 980.465759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.474404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.474488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.474578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.474757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.474845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.474940] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 is going to be created. [ 980.500136] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.500375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.500442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.500684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.500841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.510975] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: UNINITIALIZED for 2s [ 981.419502] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c in Status: SUCCESS [ 981.419718] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c deletion is rescheduled due to dependency. [ 981.419843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.521565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: SUCCESS [ 982.521923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.521923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.522218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.522372] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.522488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.522586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.522702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.522780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.522881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.522948] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.026209] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.528504] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dc78c59-d8d2-4264-8e48-80b9a24879c5: rpc.has_security_group_logging(os_id): False [ 983.546651] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.546838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.546838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.547136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.547261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.547565] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.547694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.547772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.547963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.548064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.548233] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 is going to be created. [ 983.638255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.638471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.638519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.638720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.638900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.653645] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: IN_PROGRESS for 2s [ 983.959946] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 983.960663] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 985.667297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: SUCCESS [ 985.667780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.024116] env[65455]: INFO networking_nsxv3.common.synchronization [req-921472e1-50a7-477d-9b97-7c7e6d570dfe req-050f7017-4b87-4f7b-b5b2-a9b079043545 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 986.024116] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 986.024116] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.024116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.024555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.024883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.025199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.025485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.025673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.025986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.026298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.026540] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.341480] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.341604] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.341686] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.341971] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.342287] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.342688] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.342688] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.342848] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.342943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.343249] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.343249] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.343495] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.343495] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.343661] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.343661] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.343955] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.363838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.364913] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.364913] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.364913] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-315" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.364913] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-db7a9360-ccda-4c88-a696-4e89cc5d06c7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.365158] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.365158] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.365411] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.365549] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db7a9360-ccda-4c88-a696-4e89cc5d06c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.528750] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.869334] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.869684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.869739] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.869997] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.870163] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.870320] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port db7a9360-ccda-4c88-a696-4e89cc5d06c7 not found, creating... [ 986.870585] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.870738] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.870853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.871081] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.872195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.872195] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.872195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.872195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.872195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.872195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.872195] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: db7a9360-ccda-4c88-a696-4e89cc5d06c7 is going to be created. [ 986.895315] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.895741] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.895741] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.895937] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.896189] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.896435] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.031158] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.533776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.533977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.534068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.534333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.534465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.534579] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 987.563824] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.564030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.564030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.564259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.564404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.574822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 987.621749] env[65455]: INFO networking_nsxv3.common.synchronization [req-921472e1-50a7-477d-9b97-7c7e6d570dfe req-57cb5307-ce6b-4b30-af41-ebb555e3880e service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 987.621953] env[65455]: INFO networking_nsxv3.common.synchronization [req-921472e1-50a7-477d-9b97-7c7e6d570dfe req-57cb5307-ce6b-4b30-af41-ebb555e3880e service nova] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 987.622077] env[65455]: INFO networking_nsxv3.common.synchronization [req-921472e1-50a7-477d-9b97-7c7e6d570dfe req-57cb5307-ce6b-4b30-af41-ebb555e3880e service nova] Enqueued Resource ID: db7a9360-ccda-4c88-a696-4e89cc5d06c7 with Priority: HIGHEST for action port [ 987.622964] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_rules [ 987.622964] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 987.622964] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db7a9360-ccda-4c88-a696-4e89cc5d06c7 with Priority: HIGHEST for action port [ 987.623082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.623177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.623343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.623444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.623574] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.624402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.624502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.624686] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-db7a9360-ccda-4c88-a696-4e89cc5d06c7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.624777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.624842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.625034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.625113] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db7a9360-ccda-4c88-a696-4e89cc5d06c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.126908] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.127324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.127324] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db7a9360-ccda-4c88-a696-4e89cc5d06c7 with status ACTIVE [ 988.127478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.127604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.127669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.127918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.128019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.128271] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.128401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.128456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.128619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.128699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.128904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.129090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.129090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.129258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.129371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.129649] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db7a9360-ccda-4c88-a696-4e89cc5d06c7 is going to be updated. [ 988.150800] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.151020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.151020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.151272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.151463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.151600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db7a9360-ccda-4c88-a696-4e89cc5d06c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.565907] env[65455]: INFO networking_nsxv3.common.synchronization [req-a1136711-4086-4d91-a591-21bf0cce7365 req-d810d08f-01fe-4cf2-8497-87be8ff5a88e tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 988.568762] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 988.569323] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.569557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.569744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.570086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.570367] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.570599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.570768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.570910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.571079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.571255] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.888691] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.888891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.889028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.889426] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.889701] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.889851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.889966] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.890202] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.890355] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.890556] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.890662] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.890769] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.890873] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.890978] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.891094] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.891223] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.910371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.910541] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.910679] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.910851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.911174] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-711fdbaf-363a-4591-9ca7-f1bf366f0e99 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.911394] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.911551] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.911861] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.911997] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('711fdbaf-363a-4591-9ca7-f1bf366f0e99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.073660] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.073819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.073888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.074138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.074230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.074429] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.074649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.074714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.074899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.075023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.075115] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 already deleted. [ 989.075200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.414401] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.414783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.414783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.415051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.415209] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.415365] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 711fdbaf-363a-4591-9ca7-f1bf366f0e99 not found, creating... [ 989.415648] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.415798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.415916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.416248] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.416425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.416745] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.416907] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.417120] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.417348] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.417540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.417632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 711fdbaf-363a-4591-9ca7-f1bf366f0e99 is going to be created. [ 989.441269] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.441584] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.441685] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.441952] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.442301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.442600] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.593158] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 989.593400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.593549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.593820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.594044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.594188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.594271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.594667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.594667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.594667] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.097662] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.137409] env[65455]: INFO networking_nsxv3.common.synchronization [req-a1136711-4086-4d91-a591-21bf0cce7365 req-91a085d8-bf75-4f0f-96f5-9f104db75be5 service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 990.137585] env[65455]: INFO networking_nsxv3.common.synchronization [req-a1136711-4086-4d91-a591-21bf0cce7365 req-91a085d8-bf75-4f0f-96f5-9f104db75be5 service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 990.137719] env[65455]: INFO networking_nsxv3.common.synchronization [req-a1136711-4086-4d91-a591-21bf0cce7365 req-91a085d8-bf75-4f0f-96f5-9f104db75be5 service nova] Enqueued Resource ID: 711fdbaf-363a-4591-9ca7-f1bf366f0e99 with Priority: HIGHEST for action port [ 990.138238] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 990.138401] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 990.138502] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 711fdbaf-363a-4591-9ca7-f1bf366f0e99 with Priority: HIGHEST for action port [ 990.138778] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.138894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.138959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.140141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.140231] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.142191] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.142316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.142388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.142571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.142737] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.142883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.142969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.143143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.143230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.143341] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.144152] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-711fdbaf-363a-4591-9ca7-f1bf366f0e99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.144263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.144335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.144512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.144592] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('711fdbaf-363a-4591-9ca7-f1bf366f0e99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.600358] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.649278] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.650940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.651167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.651451] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 711fdbaf-363a-4591-9ca7-f1bf366f0e99 with status ACTIVE [ 990.651812] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.652022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.652141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.652455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.652638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.653241] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.653492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.653673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.654058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.654278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.654611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.654914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.655046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.655313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.655454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.655588] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 711fdbaf-363a-4591-9ca7-f1bf366f0e99 is going to be updated. [ 990.682560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.682749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.682825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.683112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.683288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.683642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-711fdbaf-363a-4591-9ca7-f1bf366f0e99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.103155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.103376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.103376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.103564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.103659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.103758] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 991.135055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.135283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.135283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.135484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.135628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.147584] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 991.161076] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.662075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.662620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.662620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.662620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.662620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.662845] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be created. [ 991.705430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.705645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.705995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.706328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.706531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.728968] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: UNINITIALIZED for 2s [ 993.157804] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 993.158164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.158225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.158486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.159712] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.159833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.159897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.160104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.160178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.160267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.160361] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.663916] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.664194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.664311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.664640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.664810] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.664982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.665156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.665313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.665441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.665580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.665804] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.665912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.665975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.666214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.666308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.666407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.666467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.666610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.666695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.666784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.666944] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.739891] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 993.740225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.740453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.740751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.740965] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.741117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.741212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.741818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.741818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.741818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.741818] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.168889] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c376506d-a918-477c-96df-60ae10c0bcb8: rpc.has_security_group_logging(os_id): False [ 994.190534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.190534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.190534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.190820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.191098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.191168] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.191277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.191332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.191625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.191625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.191731] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.191778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.191905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.191986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.192059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.192238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.192347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.192377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.192527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.192612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.192686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 994.249566] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.254948] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.255140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.255204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.255394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.255548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.269627] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 994.752128] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f478263e-cdfa-466c-b468-3760ea97e6b8: rpc.has_security_group_logging(os_id): False [ 994.771410] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.771814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.771814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.771814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.771932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.772160] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.772270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.772321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.772477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.772554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.772639] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be created. [ 994.854513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.857023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.857023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.857023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.857023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.871499] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 994.897497] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-5cdfe44a-5073-4e82-9fbf-e81dc238b91b tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 994.898151] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 994.898577] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.898697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.898802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.899146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.899250] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.900057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.900057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.900057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.900057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.900057] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.330039] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.330416] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.330416] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.330803] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.330985] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.331181] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.331343] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.331864] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.331864] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.331864] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.332086] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 995.332086] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 995.332195] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 995.332301] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 995.332403] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 995.332780] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 995.358568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 995.358665] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 995.358827] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 995.358986] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.359363] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-e60bdc17-2c72-4da6-9650-bf248ab58aa3 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.359630] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.359750] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.360100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.360311] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e60bdc17-2c72-4da6-9650-bf248ab58aa3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.402722] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.402919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.403051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.403412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.403555] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.403843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.404040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.404720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.404720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.404720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.404720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d already deleted. [ 995.404720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.862895] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.863183] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.863317] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.863603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.863752] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.863910] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port e60bdc17-2c72-4da6-9650-bf248ab58aa3 not found, creating... [ 995.864188] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.864358] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.864478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.864699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.864835] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.865129] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.865284] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.865396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.865603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.865737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.865874] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: e60bdc17-2c72-4da6-9650-bf248ab58aa3 is going to be created. [ 995.886855] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.887156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.887241] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.887512] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.887740] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.887960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.287056] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 996.287239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.620393] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c7bfc23-22b3-48d9-b3af-ee0ef8177f83 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 996.620800] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c7bfc23-22b3-48d9-b3af-ee0ef8177f83 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 996.620800] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c7bfc23-22b3-48d9-b3af-ee0ef8177f83 service nova] Enqueued Resource ID: e60bdc17-2c72-4da6-9650-bf248ab58aa3 with Priority: HIGHEST for action port [ 996.621275] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 996.621353] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 996.621435] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e60bdc17-2c72-4da6-9650-bf248ab58aa3 with Priority: HIGHEST for action port [ 996.621697] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.621830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.621939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.622420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.622513] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.624583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.624583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.624583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.624583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.624583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.624583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.624583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.624896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.624896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.624896] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.629905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-e60bdc17-2c72-4da6-9650-bf248ab58aa3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.629905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.629905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.629905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.629905] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e60bdc17-2c72-4da6-9650-bf248ab58aa3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.887599] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 996.887599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.125894] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.126056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.130579] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.131483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e60bdc17-2c72-4da6-9650-bf248ab58aa3 with status ACTIVE [ 997.131688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.131812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.131879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.132101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.132189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.132366] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.132463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.132524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.132682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.132757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.132935] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.133037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.133099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.133236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.133308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.133390] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e60bdc17-2c72-4da6-9650-bf248ab58aa3 is going to be updated. [ 997.161970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.162137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.162137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.162430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.162631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.163148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e60bdc17-2c72-4da6-9650-bf248ab58aa3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.387468] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d8fb6793-c0f2-4a03-874e-13d1fde8f181 None None] Enqueued Resource ID: 137f96b9-8db0-4e5e-b482-f9980bda9711 with Priority: HIGHEST for action port [ 997.389024] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 137f96b9-8db0-4e5e-b482-f9980bda9711 with Priority: HIGHEST for action port [ 997.389271] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-137f96b9-8db0-4e5e-b482-f9980bda9711 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.389573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-137f96b9-8db0-4e5e-b482-f9980bda9711" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.389573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-137f96b9-8db0-4e5e-b482-f9980bda9711" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.389983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-137f96b9-8db0-4e5e-b482-f9980bda9711" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.390144] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('137f96b9-8db0-4e5e-b482-f9980bda9711',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.401640] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-0b42b151-1582-4b6a-b7f9-428c13f672a4 tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 997.402300] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 997.403028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.403028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.636470] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.760806] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.761016] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.761161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.761421] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.761663] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.761815] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.761931] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.762588] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.762748] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.763168] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.763168] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.763275] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.763275] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.763376] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.763554] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.763684] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.782144] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.782474] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.782474] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.782637] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.782959] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-a526d3d6-d355-44d7-81d6-4fd16e282f88 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.783147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.783267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.783609] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.783734] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a526d3d6-d355-44d7-81d6-4fd16e282f88',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.894091] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 137f96b9-8db0-4e5e-b482-f9980bda9711 [ 997.894354] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.894520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.894615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.894889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.895081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.895192] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:137f96b9-8db0-4e5e-b482-f9980bda9711 already deleted. [ 997.895259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-137f96b9-8db0-4e5e-b482-f9980bda9711" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.141212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.141330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.141406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.141627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.141712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.141810] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be created. [ 998.167271] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.167457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.167504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.168169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.168169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.181938] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: UNINITIALIZED for 2s [ 998.297305] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.297592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.297802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.298064] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.298241] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.298472] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port a526d3d6-d355-44d7-81d6-4fd16e282f88 not found, creating... [ 998.298797] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.298987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.299207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.299428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.299609] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.300117] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.300117] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.300313] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.300480] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.300645] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.302168] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: a526d3d6-d355-44d7-81d6-4fd16e282f88 is going to be created. [ 998.329654] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.330026] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.330211] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.330541] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.330785] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.331376] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.066502] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c1f6e3d-5e5c-426d-9514-4301fcf7bed4 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 999.066502] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c1f6e3d-5e5c-426d-9514-4301fcf7bed4 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 999.067466] env[65455]: INFO networking_nsxv3.common.synchronization [req-ca5ef07a-7afd-4679-8995-bba750ccc19d req-7c1f6e3d-5e5c-426d-9514-4301fcf7bed4 service nova] Enqueued Resource ID: a526d3d6-d355-44d7-81d6-4fd16e282f88 with Priority: HIGHEST for action port [ 999.071262] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 999.071262] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 999.071262] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a526d3d6-d355-44d7-81d6-4fd16e282f88 with Priority: HIGHEST for action port [ 999.071262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.071262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.071262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.071262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.071262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a526d3d6-d355-44d7-81d6-4fd16e282f88 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.071262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.071262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.072072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.072358] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a526d3d6-d355-44d7-81d6-4fd16e282f88',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.578176] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a526d3d6-d355-44d7-81d6-4fd16e282f88 with status ACTIVE [ 999.578436] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.578590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.578665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.579135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.579135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.579236] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.579284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.579322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.579499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.579577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.579758] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.579980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.579980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.580062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.580831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.580831] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a526d3d6-d355-44d7-81d6-4fd16e282f88 is going to be updated. [ 999.603413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.603604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.603604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.603831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.603956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.604129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a526d3d6-d355-44d7-81d6-4fd16e282f88" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.190204] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1000.191177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.191257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.191511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.191736] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.191885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.191953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.192158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.192240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.192324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.192450] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.193325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.193570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.193782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.193888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.193953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.194148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.194227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.194315] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.696713] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.697031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.697113] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.207225] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.711560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.712022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.712022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.712022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.712168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.712279] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1001.746457] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.746597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.747413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.747413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.747413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.759795] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1003.706373] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5b36a45b-783c-4b10-b8c7-324d9546d000 None None] Enqueued Resource ID: 88557645-1964-4589-9187-91aa20d7561b with Priority: HIGHEST for action port [ 1003.707510] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88557645-1964-4589-9187-91aa20d7561b with Priority: HIGHEST for action port [ 1003.707510] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-88557645-1964-4589-9187-91aa20d7561b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.707510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88557645-1964-4589-9187-91aa20d7561b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.707510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88557645-1964-4589-9187-91aa20d7561b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.708101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88557645-1964-4589-9187-91aa20d7561b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.708101] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88557645-1964-4589-9187-91aa20d7561b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.773520] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1003.773520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.776082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.776319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.776536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.776842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.776842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.776958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.776958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.778834] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.211047] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88557645-1964-4589-9187-91aa20d7561b [ 1004.211047] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.211503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.211651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.212027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.212162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.212289] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88557645-1964-4589-9187-91aa20d7561b already deleted. [ 1004.212421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88557645-1964-4589-9187-91aa20d7561b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.282263] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.395988] env[65455]: INFO networking_nsxv3.common.synchronization [req-c5681050-b2d0-410d-9201-e12088991280 req-7100f4af-0b08-4806-9ab4-a0e2d822a6aa tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1004.396573] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1004.396947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.397324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.397697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.398204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.398421] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.398569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.398645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.398814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.398926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.399054] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.786984] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.902055] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.930537] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.930641] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.931646] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.931646] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.931646] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.931646] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.931646] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.931916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.931916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.932077] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.932191] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.932299] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.932403] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.932508] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.932611] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.932741] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.953063] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.953253] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.953395] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.953923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.953980] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-bd53782c-6637-489d-9a34-92ad6c8c02c7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.954206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.954517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.954712] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.954812] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd53782c-6637-489d-9a34-92ad6c8c02c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.101193] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5c9a00b2-b386-484b-8354-02a395e7ffa2 tempest-ServersTestJSON-185825024 tempest-ServersTestJSON-185825024-project-member] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1005.101193] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1005.101655] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.102099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.102099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.102099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.102254] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.290544] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.290544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.290544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.290544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.290544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.290544] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1005.319276] env[65455]: INFO networking_nsxv3.common.synchronization [None req-788df07c-bb5f-4b22-9c51-48869e08aac1 tempest-ServersTestJSON-185825024 tempest-ServersTestJSON-185825024-project-member] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1005.319986] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1005.320359] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.320468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.321447] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.323343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.323343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.323343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.323343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.333478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1005.405365] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.457163] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.457383] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.457515] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.457798] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.457945] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.458107] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port bd53782c-6637-489d-9a34-92ad6c8c02c7 not found, creating... [ 1005.458854] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.459062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.459206] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.460058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.460613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.461151] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.461253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.461305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.461882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.461882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.461882] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: bd53782c-6637-489d-9a34-92ad6c8c02c7 is going to be created. [ 1005.484949] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.486012] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.486012] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.486127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.486361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.487351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.638942] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.639401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.639401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.639401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.639650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.639765] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d already deleted. [ 1005.639855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.640085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.640204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.640292] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.915558] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.915558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.915558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.915558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.915558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.915558] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1005.947876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.947876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.947876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.948224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.948224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.959019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1006.162280] env[65455]: INFO networking_nsxv3.common.synchronization [None req-449be640-bbbf-4105-8770-98f415119a06 None None] Enqueued Resource ID: 4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9 with Priority: HIGHEST for action port [ 1006.162280] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9 with Priority: HIGHEST for action port [ 1006.162280] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.162280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.162280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.162280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.162280] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.164080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.164254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.165186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.165186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.165186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.165186] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d already deleted. [ 1006.165186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.243102] env[65455]: INFO networking_nsxv3.common.synchronization [req-c5681050-b2d0-410d-9201-e12088991280 req-ebe9a3b2-d94a-40d4-ab09-f683c54a1905 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1006.243423] env[65455]: INFO networking_nsxv3.common.synchronization [req-c5681050-b2d0-410d-9201-e12088991280 req-ebe9a3b2-d94a-40d4-ab09-f683c54a1905 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1006.243648] env[65455]: INFO networking_nsxv3.common.synchronization [req-c5681050-b2d0-410d-9201-e12088991280 req-ebe9a3b2-d94a-40d4-ab09-f683c54a1905 service nova] Enqueued Resource ID: bd53782c-6637-489d-9a34-92ad6c8c02c7 with Priority: HIGHEST for action port [ 1006.244314] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1006.244569] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1006.244643] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd53782c-6637-489d-9a34-92ad6c8c02c7 with Priority: HIGHEST for action port [ 1006.244900] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.245056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.245129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.245374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.245469] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.246635] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.246774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.246918] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd53782c-6637-489d-9a34-92ad6c8c02c7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.247122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.247214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.247463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.247588] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd53782c-6637-489d-9a34-92ad6c8c02c7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.668761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9 [ 1006.668761] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.668761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.668761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.668761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.668761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.668761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9 already deleted. [ 1006.668761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d94d662-5eb2-416c-beb6-e4d7fd3bd0d9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.727490] env[65455]: INFO networking_nsxv3.common.synchronization [req-87915fe0-4a88-47e8-8da8-9d3236745746 req-4b043b1a-190b-4343-afe9-868436d49a03 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1006.727490] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1006.727490] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.727490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.729736] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.729736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.729736] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.750508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.750508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.750508] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd53782c-6637-489d-9a34-92ad6c8c02c7 with status ACTIVE [ 1006.750508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.750771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.750771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.750848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.751896] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.751896] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.751896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.752391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.752391] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd53782c-6637-489d-9a34-92ad6c8c02c7 is going to be updated. [ 1006.775776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.775989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.776149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.776404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.776598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.776793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd53782c-6637-489d-9a34-92ad6c8c02c7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.106127] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.106127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.106127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.106127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.106127] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.106127] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.106681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.107058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.107130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.107349] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.107468] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.107599] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.107725] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.107838] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.107945] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.108088] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.132029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.132029] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1007.132029] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.132029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-559" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.132029] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-29264147-66e1-4052-b4f4-ec834d8ba5e7 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.132029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.132029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.132559] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.132776] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29264147-66e1-4052-b4f4-ec834d8ba5e7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.237313] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.237313] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.237313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.237313] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 1007.266260] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.266566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.266660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.266899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.267059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.277613] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 1007.343166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1007.343393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.343566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.343792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.343988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.344185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.344277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.344452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.344535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.344704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.344784] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.344891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.344964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.345851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.346122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.346288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.346385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.346597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.346704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.346825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.346966] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.635762] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.636170] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.636382] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.636740] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.636936] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.637111] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 29264147-66e1-4052-b4f4-ec834d8ba5e7 not found, creating... [ 1007.637449] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.637625] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.637777] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.638082] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.638253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.638625] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.638795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.639021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.639296] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.639514] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.639698] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 29264147-66e1-4052-b4f4-ec834d8ba5e7 is going to be created. [ 1007.665954] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.666208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.666301] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.666585] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.666814] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.667054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.850123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ac3b58e-d195-4a17-8ba8-c2865a1a218d: rpc.has_security_group_logging(os_id): False [ 1007.867887] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.868127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.868127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.868648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.868648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.868648] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.868886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.868886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.868962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.869046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.869235] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.869325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.869383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.869562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.869688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.869920] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.870030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.870092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.870234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.870304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.870386] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be created. [ 1007.945476] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.945476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.945476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.945476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.945476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.957107] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1007.970644] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1007.970994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.971312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.972209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.972209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.972209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.972209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.972209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.972209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.972491] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.372828] env[65455]: INFO networking_nsxv3.common.synchronization [req-87915fe0-4a88-47e8-8da8-9d3236745746 req-8db0e2da-b8d4-4713-bbbb-a7fb9a338d25 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 1008.373208] env[65455]: INFO networking_nsxv3.common.synchronization [req-87915fe0-4a88-47e8-8da8-9d3236745746 req-8db0e2da-b8d4-4713-bbbb-a7fb9a338d25 service nova] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1008.373271] env[65455]: INFO networking_nsxv3.common.synchronization [req-87915fe0-4a88-47e8-8da8-9d3236745746 req-8db0e2da-b8d4-4713-bbbb-a7fb9a338d25 service nova] Enqueued Resource ID: 29264147-66e1-4052-b4f4-ec834d8ba5e7 with Priority: HIGHEST for action port [ 1008.373877] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_rules [ 1008.374103] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1008.374170] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29264147-66e1-4052-b4f4-ec834d8ba5e7 with Priority: HIGHEST for action port [ 1008.374473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.374602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.374682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.374905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.374995] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.376288] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.377200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.377200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-29264147-66e1-4052-b4f4-ec834d8ba5e7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.377200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.377200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.377200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.377200] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29264147-66e1-4052-b4f4-ec834d8ba5e7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.452708] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d1c38eaa-e9cd-4501-8a05-17049bd24281 None None] Enqueued Resource ID: eadc4105-a8b0-4a81-9971-c9efadb8975d with Priority: HIGHEST for action port [ 1008.453463] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eadc4105-a8b0-4a81-9971-c9efadb8975d with Priority: HIGHEST for action port [ 1008.453893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-eadc4105-a8b0-4a81-9971-c9efadb8975d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.454037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eadc4105-a8b0-4a81-9971-c9efadb8975d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.454099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eadc4105-a8b0-4a81-9971-c9efadb8975d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.454362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eadc4105-a8b0-4a81-9971-c9efadb8975d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.454439] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eadc4105-a8b0-4a81-9971-c9efadb8975d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.475210] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.878984] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.879139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.881558] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29264147-66e1-4052-b4f4-ec834d8ba5e7 with status ACTIVE [ 1008.881776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.881946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.882045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.882286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.882381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.882575] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.882684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.882760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.882919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.883018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.883200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.883292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.883351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.883490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.883563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.883647] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29264147-66e1-4052-b4f4-ec834d8ba5e7 is going to be updated. [ 1008.906976] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.907686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.907913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.908120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.908283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.908593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29264147-66e1-4052-b4f4-ec834d8ba5e7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.956087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eadc4105-a8b0-4a81-9971-c9efadb8975d [ 1008.956416] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.956676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.956781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.956951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.957056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.957162] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eadc4105-a8b0-4a81-9971-c9efadb8975d already deleted. [ 1008.957249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eadc4105-a8b0-4a81-9971-c9efadb8975d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.972799] env[65455]: INFO networking_nsxv3.common.synchronization [req-b89dafef-bbd9-4609-8c84-d123bc27cd4f req-4f030369-1cc9-4992-9b0a-548a075b1a05 tempest-ServersAdminNegativeTestJSON-629033553 tempest-ServersAdminNegativeTestJSON-629033553-project-member] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1008.973376] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1008.973683] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.973920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.973920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.974218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.974497] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.974614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.974678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.974842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.974927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.975028] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.976574] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.092136] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ffd4e106-2a8c-48ff-a792-084bd96b85c4 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1009.092812] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1009.093905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.094209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.094288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.094627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.094984] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.177372] env[65455]: INFO networking_nsxv3.common.synchronization [None req-dbf3e945-2751-415c-b8dd-59e764daac69 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1009.177500] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1009.177891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.178764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.291090] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 1009.291330] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 1009.291443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.291668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.291829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.292220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.292374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.292444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.292566] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.358646] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.358837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.358954] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.359962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.359962] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.359962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.359962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.360222] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.360383] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.360866] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.360866] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.360866] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.361038] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.361038] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.361106] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.361231] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.381515] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.381884] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.381884] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.381977] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.382312] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-c0d0144d-4a43-4ca9-9986-475004ef877e taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.382489] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.382611] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.382976] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.383145] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d0144d-4a43-4ca9-9986-475004ef877e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.477717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.477717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.477717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.478099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.478099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.478681] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.478681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.478681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.478681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.478681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.479059] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 already deleted. [ 1009.479059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.479595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.479595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.479595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.479595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.479595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.479914] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1009.514074] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.514074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.514074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.514074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.514074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.522942] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1009.617967] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.618178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.618178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.618344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.618429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.618601] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b already deleted. [ 1009.618733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.618892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.619075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.619160] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.795936] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.888150] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.888433] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.888622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.889036] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.889235] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.889417] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port c0d0144d-4a43-4ca9-9986-475004ef877e not found, creating... [ 1009.889723] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.889944] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.890101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.890353] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.890545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.890916] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.891099] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.891251] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.891477] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.891862] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.891862] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: c0d0144d-4a43-4ca9-9986-475004ef877e is going to be created. [ 1009.914690] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.915075] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.915330] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.915712] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.916152] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.916529] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.970419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1009.970419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.970419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.970861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.971065] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.141023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.141023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.141023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.141023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.141023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.141023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b already deleted. [ 1010.141023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.301861] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.475958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.475958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.475958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.475958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.476490] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.476490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.476490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.476604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.476772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.477322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.477322] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [req-b89dafef-bbd9-4609-8c84-d123bc27cd4f req-bb0c5b42-79ec-4f17-bebb-cf5e3e793e0b service nova] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_rules [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [req-b89dafef-bbd9-4609-8c84-d123bc27cd4f req-bb0c5b42-79ec-4f17-bebb-cf5e3e793e0b service nova] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [req-b89dafef-bbd9-4609-8c84-d123bc27cd4f req-bb0c5b42-79ec-4f17-bebb-cf5e3e793e0b service nova] Enqueued Resource ID: c0d0144d-4a43-4ca9-9986-475004ef877e with Priority: HIGHEST for action port [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_rules [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1010.667247] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0d0144d-4a43-4ca9-9986-475004ef877e with Priority: HIGHEST for action port [ 1010.668161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.669114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.669114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.669619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.671562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.671985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.672303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.673080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.673080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.673080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.673080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.673080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.673544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.673799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.674241] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.675564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0d0144d-4a43-4ca9-9986-475004ef877e taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.675564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.675564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.675934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.676774] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0d0144d-4a43-4ca9-9986-475004ef877e',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.807279] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.807503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.807648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.807910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.808056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.808941] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 1010.846249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.847146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.847146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.847146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.847146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.860471] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 1010.984641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.984641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.984641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.984641] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.984641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.985368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.985368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.985368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.985368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.985368] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.178675] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.178951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.183593] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.184747] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0d0144d-4a43-4ca9-9986-475004ef877e with status ACTIVE [ 1011.184987] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.185161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.185233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.185456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.185540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.185864] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.185961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.185961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.186213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.186267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.187603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.187603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.187603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.187603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.187603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.187603] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0d0144d-4a43-4ca9-9986-475004ef877e is going to be updated. [ 1011.216333] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.216480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.216582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.216843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.216972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.217148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0d0144d-4a43-4ca9-9986-475004ef877e" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.230668] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e69111a5-7e27-4f68-b714-baf2a7333fc2 None None] Enqueued Resource ID: 3d37206a-c2c5-47a8-9e80-f5b11572dbc9 with Priority: HIGHEST for action port [ 1011.231360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d37206a-c2c5-47a8-9e80-f5b11572dbc9 with Priority: HIGHEST for action port [ 1011.231589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d37206a-c2c5-47a8-9e80-f5b11572dbc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.231804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d37206a-c2c5-47a8-9e80-f5b11572dbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.231868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d37206a-c2c5-47a8-9e80-f5b11572dbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.232901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d37206a-c2c5-47a8-9e80-f5b11572dbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.232901] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d37206a-c2c5-47a8-9e80-f5b11572dbc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.489895] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ac3b58e-d195-4a17-8ba8-c2865a1a218d: rpc.has_security_group_logging(os_id): False [ 1011.512338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.512559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.512559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.512768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.512863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.513338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.513338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.513338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.513528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.513570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.513749] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.513838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.513903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.514069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.514143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.514335] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.514436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.514488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.514631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.514746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.514802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1011.533020] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1011.533020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.533020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.533020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.533859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.533859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.533859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.533859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.533859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.533859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.533859] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.588281] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.588281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.588682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.588682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.589161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.605342] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1011.690702] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.735077] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d37206a-c2c5-47a8-9e80-f5b11572dbc9 [ 1011.735384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.735511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.735584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.735861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.735966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.736141] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d37206a-c2c5-47a8-9e80-f5b11572dbc9 already deleted. [ 1011.736308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d37206a-c2c5-47a8-9e80-f5b11572dbc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.924090] env[65455]: INFO networking_nsxv3.common.synchronization [None req-98b6a147-9d0e-407f-8564-50c6e381f757 tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 with Priority: HIGHEST for action security_group_rules [ 1011.924551] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 with Priority: HIGHEST for action security_group_rules [ 1011.925230] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.925440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.925440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.925685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.925794] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7365448e-b7f7-46c7-b84a-9e69c8108ce3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.037152] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.037339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.037399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.038900] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.038900] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.038900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.041052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.041385] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.041516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.041627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.041842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.041957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.042099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.042308] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.085733] env[65455]: INFO networking_nsxv3.common.synchronization [None req-e03bca37-4100-4f6f-a3f8-595d14024d73 tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 with Priority: HIGHEST for action security_group_rules [ 1012.086504] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 with Priority: HIGHEST for action security_group_rules [ 1012.087274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.087378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.193662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.194687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.194687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.194687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.194687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.194687] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be created. [ 1012.221470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.221470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.221470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.221754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.221754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.236480] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: UNINITIALIZED for 2s [ 1012.451516] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.451516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.451516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.451774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.451774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.451774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 already deleted. [ 1012.451882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.452648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.452648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.452648] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7365448e-b7f7-46c7-b84a-9e69c8108ce3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.545202] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 1012.565220] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.565457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.565507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.565705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.565812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.566069] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.566177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.566222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.566396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.566513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.566700] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.566822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.566887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.567069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.567165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567361] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.567458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.567538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.567707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.567862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.567862] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1012.659398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.659398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.659886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.659886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.659980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.683460] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1012.873036] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 1012.873036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.873219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.873446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.873645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.873765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.873830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.873985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.874079] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.874166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.874255] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.974196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.974366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.974503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.974631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.974718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.974774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7365448e-b7f7-46c7-b84a-9e69c8108ce3 already deleted. [ 1012.974841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7365448e-b7f7-46c7-b84a-9e69c8108ce3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.376503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.376753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.376853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.377104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.377283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.377383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.377444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.377657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.377692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.377791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.377960] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.378088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.378170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.378269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.378413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.378501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.378574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.378754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.378834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.378915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.379019] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.620019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1013.620348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.882154] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d835a6b-ad66-42cb-9c87-a0b00ea650f8: rpc.has_security_group_logging(os_id): False [ 1013.905019] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.905019] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.905019] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.905019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.906184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.906416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.906808] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.907113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.907304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.907810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.908056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.908274] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 1013.920030] env[65455]: INFO networking_nsxv3.common.synchronization [req-34b46343-ff92-4929-bbf8-35a3af6d4d30 req-a726f4b9-5632-4cba-8393-57876a638821 tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1013.920030] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1013.920731] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.921206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.921433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.921792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.922120] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.922492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.924365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.924365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.924365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.924365] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.973307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.973545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.973642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.973957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.974199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.007419] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 1014.079495] env[65455]: INFO networking_nsxv3.common.synchronization [req-b6b4a0f8-f2e4-404e-8ce4-a4e95df3dd97 req-647979e9-30c7-48ec-b58e-ee06a43f432f tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1014.081035] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1014.081035] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.081266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.246770] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1014.246770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.246770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.246770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.247055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.247119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.247262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.248084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.248084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.248084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.248084] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.426403] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.699462] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1014.699807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.750550] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.750755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.750846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.751183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.751364] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.751515] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.751598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.751822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.751949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.752113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.752330] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.752483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.752586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.752791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.752991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.753154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.753241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.753431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.753519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.753602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.753696] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.929025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.171849] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f03af21-0ceb-4354-b07a-3fd039607f6b req-2af9ffe1-c62f-44da-b857-b9d4cc51a37b tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1015.172139] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1015.172903] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.172903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.172903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.172903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.173137] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.173270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.173270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.173457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.173528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.173634] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.259032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34d06a71-fbe2-479a-842a-9891893495e3: rpc.has_security_group_logging(os_id): False [ 1015.279795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.280054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.280054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.280245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.280335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.280543] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.280645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.280738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.280985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.281086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.281261] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.281369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.281433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.281558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.281626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.281821] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.281928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.282032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.282482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.282580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.282647] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be created. [ 1015.355755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.355944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.356024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.356222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.356399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.369493] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1015.432093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.432385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.432501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.432882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.433939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.433939] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1015.477226] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.477361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.477563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.477729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.477903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.491521] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1015.677034] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.677034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.677231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.677326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.678087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.678087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.678087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.678087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.678087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.678087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.678087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1015.721030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.721030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.721030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.721030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.721030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.735859] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1016.023533] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 1016.023938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.382261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1017.382620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.498856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1017.499110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.499277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.499496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.499795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.499941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.500029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.500518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.500518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.500518] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.747047] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1017.747047] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 1017.747228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.797799] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f95a1b7-d50f-4e70-a2fa-1a1609d3eb8c req-ac150365-a9fe-45fa-b747-7441b2452ae8 tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1017.798391] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1017.798726] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.798900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.798980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.799254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.799478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.799604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.799724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.799880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.799977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.800088] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.003056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.003507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.003507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.003725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.003725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.003993] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.004194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.004264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.004565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.004640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.004807] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1018.039386] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.039697] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.039848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.040136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.040348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.051796] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1018.157482] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-30 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.157643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.157685] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.159045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.159045] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.159045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.159045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.159045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.159045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.159365] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.159463] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.159613] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.159797] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.159949] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.160108] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.161087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.180951] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.181242] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.181336] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.181515] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.181830] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-53637d47-0607-461b-9c9b-9ebda1c748d4 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.182347] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.182486] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.182830] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.182975] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53637d47-0607-461b-9c9b-9ebda1c748d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.302435] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.302435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.302610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.302703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.302807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.302997] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.303111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.303201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.303331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.303403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.303487] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1018.304530] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1018.304641] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:2 started [ 1018.332145] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.332420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.332532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.332803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.333021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.346132] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1018.685089] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.685612] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.685612] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.685776] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.685927] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.686114] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 53637d47-0607-461b-9c9b-9ebda1c748d4 not found, creating... [ 1018.686388] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.686731] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.686911] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.687204] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.687381] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.687684] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.687872] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.688037] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.688274] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.688523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.688590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 53637d47-0607-461b-9c9b-9ebda1c748d4 is going to be created. [ 1018.714416] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.714613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.714613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.714874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.715216] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.715466] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.409387] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f95a1b7-d50f-4e70-a2fa-1a1609d3eb8c req-069899db-25d3-4fd4-8591-92d139198b1e service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1019.409387] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f95a1b7-d50f-4e70-a2fa-1a1609d3eb8c req-069899db-25d3-4fd4-8591-92d139198b1e service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1019.409519] env[65455]: INFO networking_nsxv3.common.synchronization [req-7f95a1b7-d50f-4e70-a2fa-1a1609d3eb8c req-069899db-25d3-4fd4-8591-92d139198b1e service nova] Enqueued Resource ID: 53637d47-0607-461b-9c9b-9ebda1c748d4 with Priority: HIGHEST for action port [ 1019.410078] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1019.410280] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1019.410347] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53637d47-0607-461b-9c9b-9ebda1c748d4 with Priority: HIGHEST for action port [ 1019.410583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.410772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.410772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.410975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.411038] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.412534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.412667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.412847] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-53637d47-0607-461b-9c9b-9ebda1c748d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.412963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.413008] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.413187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.413262] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53637d47-0607-461b-9c9b-9ebda1c748d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.915255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.915681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.915764] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53637d47-0607-461b-9c9b-9ebda1c748d4 with status ACTIVE [ 1019.915994] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.916166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.916374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.916583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.916738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.916997] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.917164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.917280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.917509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.917634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.917914] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.918082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.918203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.918428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.918566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.918762] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53637d47-0607-461b-9c9b-9ebda1c748d4 is going to be updated. [ 1019.941894] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.941894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.941894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.941894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.941894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.942165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53637d47-0607-461b-9c9b-9ebda1c748d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.066655] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1020.066655] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d deletion is rescheduled due to dependency. [ 1020.066655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.293350] env[65455]: INFO networking_nsxv3.common.synchronization [req-d2c7c1c7-9049-4dc5-9721-10ee61fc11e0 req-c1661641-ecc8-40f8-930f-c409fdccd2bc tempest-ServersTestJSON-185825024 tempest-ServersTestJSON-185825024-project-member] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1020.293461] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1020.293898] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.293898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.294066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.294431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.294744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.294891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.295095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.295359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.295490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.295611] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.357604] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1020.357848] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef deletion is rescheduled due to dependency. [ 1020.357888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.358042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.358275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.358433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.358550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.358652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.358802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.358884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.358978] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.651196] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-878 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.651436] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-878" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.651607] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-878" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.651981] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-878" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.652308] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.652478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.652594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.652851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.653054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.653356] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.653420] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.653720] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.653720] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.653720] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.653930] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.653930] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.675960] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.676492] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.676908] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.677207] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-878" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.677731] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-4b478dc0-bf59-4812-b2c8-2025495fb051 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.678107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.678262] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.678744] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.678953] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b478dc0-bf59-4812-b2c8-2025495fb051',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.799757] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.799757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.799757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.799757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.799997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.800045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.800734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.800734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.800734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.800734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.800734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d already deleted. [ 1020.800734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.861433] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.182984] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.182984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.183436] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.183695] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.183903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.184280] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 4b478dc0-bf59-4812-b2c8-2025495fb051 not found, creating... [ 1021.184504] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.184728] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.184898] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.186444] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.186716] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.187151] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.187361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.187678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.188111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.188111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.188111] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 4b478dc0-bf59-4812-b2c8-2025495fb051 is going to be created. [ 1021.209847] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.210085] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.210199] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.210484] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.210741] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.211014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.365463] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.868664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.868861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.868951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.869233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.869636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.869636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1021.905342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.905559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.905606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.905882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.906078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.914754] env[65455]: INFO networking_nsxv3.common.synchronization [req-d2c7c1c7-9049-4dc5-9721-10ee61fc11e0 req-ab9fd82d-cb99-4302-9e8d-293fd94e4a22 service nova] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1021.914950] env[65455]: INFO networking_nsxv3.common.synchronization [req-d2c7c1c7-9049-4dc5-9721-10ee61fc11e0 req-ab9fd82d-cb99-4302-9e8d-293fd94e4a22 service nova] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1021.915171] env[65455]: INFO networking_nsxv3.common.synchronization [req-d2c7c1c7-9049-4dc5-9721-10ee61fc11e0 req-ab9fd82d-cb99-4302-9e8d-293fd94e4a22 service nova] Enqueued Resource ID: 4b478dc0-bf59-4812-b2c8-2025495fb051 with Priority: HIGHEST for action port [ 1021.915886] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_rules [ 1021.916297] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1021.916345] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b478dc0-bf59-4812-b2c8-2025495fb051 with Priority: HIGHEST for action port [ 1021.917614] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1021.917614] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.917928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.917928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.918063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.918185] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.919303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.919441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.919498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.919722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.919908] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.920057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.920135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.920335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.920456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.920556] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.921580] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b478dc0-bf59-4812-b2c8-2025495fb051 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.921946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.921946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.922030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.922104] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b478dc0-bf59-4812-b2c8-2025495fb051',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.423726] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.425549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.426149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.426370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b478dc0-bf59-4812-b2c8-2025495fb051 with status ACTIVE [ 1022.430026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.430026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.430026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.430026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.430026] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b478dc0-bf59-4812-b2c8-2025495fb051 is going to be updated. [ 1022.452186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.453231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.453231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.453231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.453231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.453413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b478dc0-bf59-4812-b2c8-2025495fb051" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.827795] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fd87ebd-a0f9-4630-8392-051ecb83bd60 req-9c3582ab-b4dc-4d0a-bf4d-63048e66d1b6 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1022.828366] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1022.828762] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.828876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.828960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.829247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.829420] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.829513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.829566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.829771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.829874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.829962] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.926562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.138252] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.138428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.138533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.138944] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.139219] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.139382] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.139498] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.139761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.139909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.140181] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.140299] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.140424] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.140518] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.140628] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.140732] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.140862] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.160129] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.160355] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.160541] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.160766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.161251] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-a25a131d-7453-43b8-8d8f-f0774ebe8c41 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.161502] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.161678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.162137] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.162341] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25a131d-7453-43b8-8d8f-f0774ebe8c41',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.335907] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.336105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.336176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.336759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.336949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.337199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.337315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.337380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.337544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.337623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.337734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b already deleted. [ 1023.337821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.430501] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.430825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.430825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.430933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.431065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.431119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d is going to be created. [ 1023.459738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.459930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.459989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.460271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.460458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.477159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: UNINITIALIZED for 2s [ 1023.665181] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.665496] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.665666] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.666045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.666247] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.666453] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port a25a131d-7453-43b8-8d8f-f0774ebe8c41 not found, creating... [ 1023.666843] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.667070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.667237] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.667546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.667746] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.668185] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.668355] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.668525] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.668825] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.669015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.669204] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: a25a131d-7453-43b8-8d8f-f0774ebe8c41 is going to be created. [ 1023.700114] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.700351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.700479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.700791] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.701118] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.701369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.929653] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1023.929896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.930174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.930429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.930652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.930793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.930878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.931049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.931120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.931210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.931313] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.099268] env[65455]: INFO networking_nsxv3.common.synchronization [req-f18a1efb-ca16-43da-a7c7-7d9bdd182e27 req-a1b02495-d952-496f-b187-2cc04e1eda14 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 1024.099982] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 with Priority: HIGHEST for action security_group_members [ 1024.100325] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a18e5b54-8a6d-4a7c-985e-7a6963e15109 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.100480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.100546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.100709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.100858] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.101060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.101060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.101201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.101260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.101383] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a18e5b54-8a6d-4a7c-985e-7a6963e15109',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.426736] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fd87ebd-a0f9-4630-8392-051ecb83bd60 req-a8c052ee-dcf9-4e29-9ee5-8851c017bfb3 service nova] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1024.426799] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fd87ebd-a0f9-4630-8392-051ecb83bd60 req-a8c052ee-dcf9-4e29-9ee5-8851c017bfb3 service nova] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1024.426957] env[65455]: INFO networking_nsxv3.common.synchronization [req-7fd87ebd-a0f9-4630-8392-051ecb83bd60 req-a8c052ee-dcf9-4e29-9ee5-8851c017bfb3 service nova] Enqueued Resource ID: a25a131d-7453-43b8-8d8f-f0774ebe8c41 with Priority: HIGHEST for action port [ 1024.427466] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_rules [ 1024.427622] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1024.427700] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a25a131d-7453-43b8-8d8f-f0774ebe8c41 with Priority: HIGHEST for action port [ 1024.428279] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.431225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.431545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.431545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.431651] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.432939] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.433117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.433190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.433375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.433537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.433636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.433700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.433894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.434133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.434671] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.435802] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a25a131d-7453-43b8-8d8f-f0774ebe8c41 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.435909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.435977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.436143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.436221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a25a131d-7453-43b8-8d8f-f0774ebe8c41',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.437386] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.603450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.603618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.603694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.604075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.626733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.627087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.627371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.627371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.627484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.627599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.627681] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 is going to be updated. [ 1024.656754] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.656937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.656994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.657225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.657373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.666857] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: IN_PROGRESS for 2s [ 1024.937661] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.937855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.939132] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a25a131d-7453-43b8-8d8f-f0774ebe8c41 with status ACTIVE [ 1024.939332] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.939448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.939527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.939789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.939914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.940053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.940156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.940213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.940364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.940461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.940611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.940691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.940752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.940889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.940963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.941058] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a25a131d-7453-43b8-8d8f-f0774ebe8c41 is going to be updated. [ 1024.942541] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.944277] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 1024.960561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.960838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.961204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.961299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.961380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.961634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.961741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.961864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.961987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.962095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.962225] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1024.965996] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.966166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.966253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.966488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.966666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.966871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a25a131d-7453-43b8-8d8f-f0774ebe8c41" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.146242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.146465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.146465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.146655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.146804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.162918] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1025.445700] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.489077] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: SUCCESS [ 1025.490038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.490038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.490038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.490038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.490305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.490305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.490365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.490453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.490547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.490638] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.948834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.948998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.949093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.949315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.949416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.949521] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b is going to be created. [ 1025.973028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.973028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.973028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.973269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.973308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.984340] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: UNINITIALIZED for 2s [ 1025.992907] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.417075] env[65455]: INFO networking_nsxv3.common.synchronization [req-e06bbcb4-6afe-4a02-b478-8e61ec99f5f9 req-fc2af266-fa97-4890-a7da-dec65f520dfe tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1026.417809] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1026.418175] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.418339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.418714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.418714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.418868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.418971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.419048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.419230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.419333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.419408] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.495406] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfc86584-6c08-4a39-8d62-18bde1a7dd9d: rpc.has_security_group_logging(os_id): False [ 1026.518381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.518592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.518722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.519086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.520083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.520083] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.520083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.520083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.520083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.520083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.520426] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d is going to be created. [ 1026.583662] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.583848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.583848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.584118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.584307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.598149] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: IN_PROGRESS for 2s [ 1026.677040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 in Status: SUCCESS [ 1026.677040] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a18e5b54-8a6d-4a7c-985e-7a6963e15109 deletion is rescheduled due to dependency. [ 1026.677234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a18e5b54-8a6d-4a7c-985e-7a6963e15109" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.809265] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.809457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.809568] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.809854] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.810126] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.810310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.810381] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.810606] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.810754] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.810976] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.811085] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.811194] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.811301] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.811437] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.811503] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.811635] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.832023] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.833267] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.833267] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.833267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.833267] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-d153507e-beff-4503-bac0-ea5fdb244f03 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.833267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.833267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.833597] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.833735] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d153507e-beff-4503-bac0-ea5fdb244f03',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.921514] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.921668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.921729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.922015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.922083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.922325] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.922428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.922485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.922645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.922710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.922796] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1026.951402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.951550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.951620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.951829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.951967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.961860] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1027.183816] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1027.184109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.336046] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.336337] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.336441] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.336810] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.337037] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.337228] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port d153507e-beff-4503-bac0-ea5fdb244f03 not found, creating... [ 1027.337512] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.337698] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.337850] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.338191] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.338357] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.338727] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.338930] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.339122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.339396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.339540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.339686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: d153507e-beff-4503-bac0-ea5fdb244f03 is going to be created. [ 1027.361900] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.362143] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.362269] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.362543] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.362815] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.363062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.995246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: SUCCESS [ 1027.995536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.995772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.996104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.996370] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.996527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.996668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.997012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.997213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.997278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.997408] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.064946] env[65455]: INFO networking_nsxv3.common.synchronization [req-e06bbcb4-6afe-4a02-b478-8e61ec99f5f9 req-117903c1-3290-4092-ac07-5a0e91302679 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 1028.064946] env[65455]: INFO networking_nsxv3.common.synchronization [req-e06bbcb4-6afe-4a02-b478-8e61ec99f5f9 req-117903c1-3290-4092-ac07-5a0e91302679 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1028.064946] env[65455]: INFO networking_nsxv3.common.synchronization [req-e06bbcb4-6afe-4a02-b478-8e61ec99f5f9 req-117903c1-3290-4092-ac07-5a0e91302679 service nova] Enqueued Resource ID: d153507e-beff-4503-bac0-ea5fdb244f03 with Priority: HIGHEST for action port [ 1028.065474] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 1028.065666] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1028.065720] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d153507e-beff-4503-bac0-ea5fdb244f03 with Priority: HIGHEST for action port [ 1028.066196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.066383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.066383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.066487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.066593] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.067597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.067684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.067882] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d153507e-beff-4503-bac0-ea5fdb244f03 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.067978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.068055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.068297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.068385] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d153507e-beff-4503-bac0-ea5fdb244f03',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.499763] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.570795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.570995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.571199] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d153507e-beff-4503-bac0-ea5fdb244f03 with status ACTIVE [ 1028.571380] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.571489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.571554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.571839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.571905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.572046] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.572181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.572248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.572350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.572425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.572602] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.572702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.572784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.572942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.573031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.573119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d153507e-beff-4503-bac0-ea5fdb244f03 is going to be updated. [ 1028.598426] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.598652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.598652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.598887] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.599041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.599209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d153507e-beff-4503-bac0-ea5fdb244f03" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.611525] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: SUCCESS [ 1028.612261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.972636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1028.972835] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 1028.972946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.973126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.973376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.973558] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.973710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.973782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.973942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.974034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.974131] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.004881] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2391e1ec-f04f-463f-aaa0-77abb954955b: rpc.has_security_group_logging(os_id): False [ 1029.022779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.022933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.022986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.023263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.023347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.023606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.024081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.024189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.024381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.024458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.024554] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b is going to be created. [ 1029.114462] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.114636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.114636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.114788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.114987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.127802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: IN_PROGRESS for 2s [ 1029.477430] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.982589] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.486681] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.486681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.486681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.487197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.487197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.487284] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1030.522082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.522256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.522351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.522698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.522913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.534460] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1030.978573] env[65455]: INFO networking_nsxv3.common.synchronization [req-2a75abf3-5103-42cd-9761-e7fba3fa2bca req-802c0794-fc0f-4f53-974b-c8caf824f82b tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1030.978969] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1030.979321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.979475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.979525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.979712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.980066] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.980066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.980426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.981037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.981165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.981269] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.140302] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: SUCCESS [ 1031.140535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.482995] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.985827] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.490155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.490155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.490155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.490155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.490155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.490155] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 1032.531039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.531340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.531340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.531769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.531769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.546865] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 1032.548150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1032.548374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.548647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.549028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.549264] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.549412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.549489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.549692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.549831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.549987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.550192] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.053687] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.053687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.054194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.054194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.054293] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.054451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.054588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.054785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.054913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.055052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.055171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.055271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.055339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.055606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.055606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.055862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.055862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.055946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.055980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.056075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.056183] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.559541] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de94ae8c-64b4-4119-bf51-89a5595f402a: rpc.has_security_group_logging(os_id): False [ 1033.582194] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.582397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.582507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.582753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.582886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.583427] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.583544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.583585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.583766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.583857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.584075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.584176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.584239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.584388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.585307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.585690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.585808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.585883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.586109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.586163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.586222] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1033.668597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.668782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.668872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.669105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.669313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.693906] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1034.560277] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 1034.560771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.710914] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1035.711311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.979865] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1035.980025] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1036.101673] env[65455]: INFO networking_nsxv3.common.synchronization [req-be605395-76ba-4c49-ba5d-e7ee3754f4e1 req-78f4f6b2-129c-4318-be0f-41558e4d4e60 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1036.102237] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1036.102556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.102675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.102743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.102939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.103170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.103273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.103335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.103529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.103578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.103660] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.493575] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.493845] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.494142] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.495096] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.495401] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.495617] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.495747] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.495988] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.496149] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.496364] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.496478] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.496639] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.496759] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.496875] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.496983] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.497142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.522952] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.523163] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1036.523320] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.523510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.523834] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.523972] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.524123] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.525220] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.525220] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23cb9ea8-45bc-4575-a1f8-7f3eb208ee33',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.607133] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.029781] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.030150] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.030205] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.030629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.030629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.030805] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 not found, creating... [ 1037.031071] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.031255] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.031393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.031628] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.031766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.032066] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.032224] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.032340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.032545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.032677] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.032814] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 is going to be created. [ 1037.055965] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.056240] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.056240] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.056578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.057052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.057174] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.075573] env[65455]: INFO networking_nsxv3.common.synchronization [None req-acabebd6-60cf-4c10-ba19-e1644cd6d4fe tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1037.076079] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1037.076387] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.076511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.076654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.076914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.077009] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.110570] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.179373] env[65455]: INFO networking_nsxv3.common.synchronization [None req-7969c257-a30d-4c3c-8278-2a8131d756cf tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1037.180119] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1037.180412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.180511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.596527] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.597047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.597047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.597047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.597161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.597197] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 already deleted. [ 1037.597270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.597421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.597646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.597771] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.613088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.613292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.613345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.613616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.613709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.613806] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1037.642628] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.642810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.642875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.643099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.643248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.653126] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1037.782059] env[65455]: INFO networking_nsxv3.common.synchronization [req-be605395-76ba-4c49-ba5d-e7ee3754f4e1 req-b7fdc496-f96b-41f7-b396-371bb8f1db3d service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1037.782278] env[65455]: INFO networking_nsxv3.common.synchronization [req-be605395-76ba-4c49-ba5d-e7ee3754f4e1 req-b7fdc496-f96b-41f7-b396-371bb8f1db3d service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1037.782420] env[65455]: INFO networking_nsxv3.common.synchronization [req-be605395-76ba-4c49-ba5d-e7ee3754f4e1 req-b7fdc496-f96b-41f7-b396-371bb8f1db3d service nova] Enqueued Resource ID: 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 with Priority: HIGHEST for action port [ 1037.783023] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1037.783161] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1037.783254] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 with Priority: HIGHEST for action port [ 1037.783548] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.783862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.783862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.783999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.783999] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.784862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.784961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.785166] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.785281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.785363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.785571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.785650] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23cb9ea8-45bc-4575-a1f8-7f3eb208ee33',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.121374] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.121374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.121374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.121374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.121374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.121374] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 already deleted. [ 1038.121374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.288265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.288658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.290106] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 with status ACTIVE [ 1038.290339] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.290505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.290578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.291041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.291041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.291041] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.291235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.291235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.291434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.291434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.291617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.291713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.291784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.291907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.291978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.292076] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23cb9ea8-45bc-4575-a1f8-7f3eb208ee33 is going to be updated. [ 1038.319405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.319405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.319405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.319700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.319949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.320283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23cb9ea8-45bc-4575-a1f8-7f3eb208ee33" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.664448] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1039.664902] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.665108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.665506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.665850] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.666112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.666217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.666472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.666563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.666690] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.169843] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.671713] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.175032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.175032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.175032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.175714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.175714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.175714] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1041.211222] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.212086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.212086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.212086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.212086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.221614] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1041.274125] env[65455]: INFO networking_nsxv3.common.synchronization [req-f422d82e-d42a-474b-af9f-eb5c6491c5c2 req-1a286283-bb7a-4671-89d3-a9c1b20ee734 tempest-ServersAdminNegativeTestJSON-629033553 tempest-ServersAdminNegativeTestJSON-629033553-project-member] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1041.274334] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1041.274622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.274758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.274806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.274997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.278062] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.278176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.278461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.279604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.279757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.279894] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.636050] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-66 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.636265] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.636390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.636717] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.637068] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.637234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.637350] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.637575] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.637718] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.637927] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.638063] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.638176] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.638283] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.638393] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.638497] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.638625] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.659134] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.659318] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.659442] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.659624] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-66" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.659940] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-b149cdf5-a329-455e-90fb-b1915a3deede taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.660124] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.660278] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.660579] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.660711] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b149cdf5-a329-455e-90fb-b1915a3deede',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.782782] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.169212] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.169446] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.169568] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.169877] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.170030] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.170188] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port b149cdf5-a329-455e-90fb-b1915a3deede not found, creating... [ 1042.170457] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.170618] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.170731] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.170968] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.171121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.171409] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.171565] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.171680] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.171886] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.172046] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.172190] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: b149cdf5-a329-455e-90fb-b1915a3deede is going to be created. [ 1042.196953] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.196953] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.196953] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.197212] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.197414] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.197638] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.285256] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.788970] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.788970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.788970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.789563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.789563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.789563] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1042.823356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.823594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.823594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.823898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.824104] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.836245] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1042.942247] env[65455]: INFO networking_nsxv3.common.synchronization [req-f422d82e-d42a-474b-af9f-eb5c6491c5c2 req-d2382205-84be-4dd8-b6f0-d22664c7f908 service nova] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_rules [ 1042.942421] env[65455]: INFO networking_nsxv3.common.synchronization [req-f422d82e-d42a-474b-af9f-eb5c6491c5c2 req-d2382205-84be-4dd8-b6f0-d22664c7f908 service nova] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1042.942664] env[65455]: INFO networking_nsxv3.common.synchronization [req-f422d82e-d42a-474b-af9f-eb5c6491c5c2 req-d2382205-84be-4dd8-b6f0-d22664c7f908 service nova] Enqueued Resource ID: b149cdf5-a329-455e-90fb-b1915a3deede with Priority: HIGHEST for action port [ 1042.943496] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_rules [ 1042.943707] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1042.943707] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b149cdf5-a329-455e-90fb-b1915a3deede with Priority: HIGHEST for action port [ 1042.943929] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.946228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.946228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.946228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.946228] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.946228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.946228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.946228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b149cdf5-a329-455e-90fb-b1915a3deede taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.946501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.946501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.946708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.946852] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b149cdf5-a329-455e-90fb-b1915a3deede',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.245025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.245025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.245025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.448597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.448597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.448982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b149cdf5-a329-455e-90fb-b1915a3deede with status ACTIVE [ 1043.448982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.449156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.449206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.449809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.449809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.449809] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.450035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.450035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.450134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.450217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.451483] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.451483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.451483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.451483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.451483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.451483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b149cdf5-a329-455e-90fb-b1915a3deede is going to be updated. [ 1043.475442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.475714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.475714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.475885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.476044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.476265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b149cdf5-a329-455e-90fb-b1915a3deede" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.750056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.750244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.750244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.750529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.750722] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.750876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.750979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.751203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.751325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.751654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.751654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.751782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.751782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.751935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.752097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.752215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.752276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.752387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.752462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.752543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.752701] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.794449] env[65455]: INFO networking_nsxv3.common.synchronization [None req-498ed9f9-347d-4706-a2af-1c9e00d099db tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1043.795243] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1043.795830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.795830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.795975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.796194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.796289] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.890459] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ad9862ea-f587-4632-99c7-362817c40615 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1043.891078] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1043.891394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.891501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.255316] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 1044.274242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.274469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.274469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.274778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.274912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.275241] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.275391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.275475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.275693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.275782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.276017] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.276119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.276180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.276326] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.276413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.276685] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.276852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.276938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.277125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.277247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.277379] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1044.325645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.325893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.325893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.326071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.326161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.326260] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 already deleted. [ 1044.326345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.326936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.327123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.327196] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.385159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.385363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.385410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.385596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.385741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.404745] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1044.849457] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1044.849758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.850266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.850510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.850708] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.850829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.850916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.851107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.851193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.851287] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.853033] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.853132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.853132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.853310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.853393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.853483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 already deleted. [ 1044.853566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.356649] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.859052] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.361503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.361743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.361896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.362105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.362201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.362330] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1046.402590] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.402826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.402826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.403041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.403174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.413268] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1046.419423] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1046.419640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.767318] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-6e9023a6-6938-4c64-96b8-71508a1b7e2b tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1046.767921] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1046.768262] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.768389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.768824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.769034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.769186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.769297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.769412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.769522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.769644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.769762] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.103581] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.103940] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.103940] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.104613] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.104728] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.104896] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.105107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.105396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.105611] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.105861] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.106013] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.106158] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.106290] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.106426] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.106555] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.106786] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.127952] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.128299] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.128539] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.128730] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.129162] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.129408] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.129622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.130065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.130285] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b150bdcb-66b1-4c83-b5f1-2fc0190be76d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.272775] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.272987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.273040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.273245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.273329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.273521] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.273622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.273684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.273838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.273915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.273999] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1047.309096] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.309281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.309354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.309562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.309704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.318428] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1047.632495] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.632754] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.632891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.633233] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.633422] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.633603] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port b150bdcb-66b1-4c83-b5f1-2fc0190be76d not found, creating... [ 1047.633888] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.634081] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.634226] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.634487] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.634643] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.634942] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.635148] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.635288] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.635523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.635677] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.635831] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: b150bdcb-66b1-4c83-b5f1-2fc0190be76d is going to be created. [ 1047.657341] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.657546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.657668] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.657944] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.658186] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.658411] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.381148] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-2067f1b1-06ec-4fdf-80e0-fe2b21ed4465 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 1048.381475] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-2067f1b1-06ec-4fdf-80e0-fe2b21ed4465 service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1048.381475] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-2067f1b1-06ec-4fdf-80e0-fe2b21ed4465 service nova] Enqueued Resource ID: b150bdcb-66b1-4c83-b5f1-2fc0190be76d with Priority: HIGHEST for action port [ 1048.382360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 1048.382895] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1048.383477] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b150bdcb-66b1-4c83-b5f1-2fc0190be76d with Priority: HIGHEST for action port [ 1048.383835] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.384092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.384169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.384432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.384566] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.385949] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.386076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.388749] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.388749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.388749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.388749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.388749] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b150bdcb-66b1-4c83-b5f1-2fc0190be76d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.427205] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1048.427554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.427827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.428183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.428490] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.428679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.428810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.429073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.429164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.429297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.429354] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.890070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.890232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.893763] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b150bdcb-66b1-4c83-b5f1-2fc0190be76d with status ACTIVE [ 1048.893974] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.894118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.894185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.894401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.894497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.894670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.894770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.894832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.895064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.895119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.895304] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.895400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.895460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.895601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.895675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.895761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b150bdcb-66b1-4c83-b5f1-2fc0190be76d is going to be updated. [ 1048.918553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.918686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.918686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.918953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.919114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.919275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b150bdcb-66b1-4c83-b5f1-2fc0190be76d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.931862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.932047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.932120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.932470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.932552] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.932744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.932744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.932976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.933091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.933207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.933420] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.933527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.933592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.933735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.933874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.933967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.934039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.934180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.934255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.934335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.934424] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.265244] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-54a015cd-7f31-497c-9355-98b02346838c tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1049.266567] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1049.266567] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.266567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.333518] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1049.333518] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d deletion is rescheduled due to dependency. [ 1049.333700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.334210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.334432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.334617] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.334739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.334805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.334967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.335066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.335160] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.436297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34d06a71-fbe2-479a-842a-9891893495e3: rpc.has_security_group_logging(os_id): False [ 1049.458037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.458037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.458037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.459212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.459212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.459931] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.460721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.460721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.460721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.461153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.461153] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1049.532410] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.532748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.532748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.532970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.532970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.565786] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1049.635522] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.635891] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.636134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.636563] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.637073] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.637358] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.637499] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.637639] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.637785] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.638022] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.638138] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.638232] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.638339] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.638441] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.638539] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.638670] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.666552] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.666807] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.666879] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.667068] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-815" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.667407] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-3902112e-4c56-41cd-90f8-37e78f09d536 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.667578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.667858] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.668363] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.668559] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3902112e-4c56-41cd-90f8-37e78f09d536',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.836992] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.171074] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.171343] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.171407] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.171696] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.171851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.172016] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 3902112e-4c56-41cd-90f8-37e78f09d536 not found, creating... [ 1050.172288] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.172447] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.172592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.172824] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.172976] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.173420] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.173587] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.173718] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.173904] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.174052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.174194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 3902112e-4c56-41cd-90f8-37e78f09d536 is going to be created. [ 1050.197240] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.197476] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.197621] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.197912] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.198156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.198394] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.339566] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.841796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.842249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.842249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.842370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.842409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.842533] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1050.884813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.884970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.885057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.885281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.885445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.903185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1050.919035] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-37637533-a99a-4f78-884a-9d7d71f284fd service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 1050.919750] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-37637533-a99a-4f78-884a-9d7d71f284fd service nova] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1050.919984] env[65455]: INFO networking_nsxv3.common.synchronization [req-bf327f37-5e5e-488d-a80e-c0865a3558f6 req-37637533-a99a-4f78-884a-9d7d71f284fd service nova] Enqueued Resource ID: 3902112e-4c56-41cd-90f8-37e78f09d536 with Priority: HIGHEST for action port [ 1050.920558] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_rules [ 1050.920705] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1050.920802] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3902112e-4c56-41cd-90f8-37e78f09d536 with Priority: HIGHEST for action port [ 1050.921103] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.921264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.921462] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.921539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.921715] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3902112e-4c56-41cd-90f8-37e78f09d536 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.921811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.921864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.922087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.922164] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3902112e-4c56-41cd-90f8-37e78f09d536',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.252382] env[65455]: INFO networking_nsxv3.common.synchronization [req-6dc9ef08-243b-493e-8963-1ef571873c02 req-8912ff79-7c8f-4925-9153-9db7b5aa7d81 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1051.253061] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1051.253393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.253522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.253577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.253790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.253946] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.254069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.257768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.257768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.257768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.257768] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.428028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3902112e-4c56-41cd-90f8-37e78f09d536 with status ACTIVE [ 1051.428028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.428028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.428028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.428028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.428028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3902112e-4c56-41cd-90f8-37e78f09d536 is going to be updated. [ 1051.456182] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.456553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.456764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.457252] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.457435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.457661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3902112e-4c56-41cd-90f8-37e78f09d536" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.585101] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1051.585224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.760478] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.266045] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.768489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.768658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.768748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.769029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.769118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.769228] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1052.803044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.803316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.803458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.803764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.803964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.814165] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1052.921734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1052.921964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.922179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.922405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.922618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.922802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.922802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.922961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.923084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.923180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.923284] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.924180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.924351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.924508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.924606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.924672] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.924806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.924884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.924972] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.426973] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.428989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.439769] env[65455]: INFO networking_nsxv3.common.synchronization [req-798ca67e-6b67-4cfb-880c-2786a5c76766 req-34764c9b-36ef-40df-a774-87249c64dbb0 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1053.440384] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1053.440805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.440968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.441086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.441388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.441503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.441629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.441719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.442563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.442563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.442563] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.931122] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.945135] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.433872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.434279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.434279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.434491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.434491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.434590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1054.448025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.483581] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.483745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.483810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.484476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.484674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.495470] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1054.824440] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1054.824729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.950652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.951683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.951683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.951683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.951683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.951683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 1054.981357] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.981613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.981613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.981890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.982160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.992913] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 1056.332702] env[65455]: INFO networking_nsxv3.common.synchronization [req-da4e0e86-9261-44ea-9cd7-8f042a6d17ef req-8551694b-8c33-4a9c-aa7a-842f3ff267fb tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1056.333365] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1056.333774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.333924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.334016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.334297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.334465] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.334635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.334699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.334869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.334981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.335099] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.507767] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1056.508101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.508357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.508686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.509121] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.509249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.509337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.509586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.509718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.510082] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.695730] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.695985] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.696099] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.696513] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.697473] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.697473] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.697657] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.698417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.698417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.698417] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.698417] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.698605] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.698694] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.698812] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.698942] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.699092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.719470] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.719633] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.719768] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.719972] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.720328] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-599f68a1-ce79-47d3-8b54-0d500b742489 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.721017] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.721017] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.721017] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.721359] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('599f68a1-ce79-47d3-8b54-0d500b742489',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.838059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.838219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.838288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.838484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.838577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.838787] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.838936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.839124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.839181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.839266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.839354] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 already deleted. [ 1056.839435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.004986] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 1057.009019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.015190] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.223710] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.224159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.224424] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.224797] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.225071] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.225373] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 599f68a1-ce79-47d3-8b54-0d500b742489 not found, creating... [ 1057.226140] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.226563] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.226944] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.227434] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.227759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.228426] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.228767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.229111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.229676] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.230032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.230386] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 599f68a1-ce79-47d3-8b54-0d500b742489 is going to be created. [ 1057.253199] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.253550] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.253699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.254107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.254492] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.254832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.521324] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.784258] env[65455]: INFO networking_nsxv3.common.synchronization [req-6414048d-3c01-4809-9b0d-9a8f6098845c req-53d39435-acb6-4e51-856b-68a96a91bc8e tempest-ServersAdminNegativeTestJSON-629033553 tempest-ServersAdminNegativeTestJSON-629033553-project-member] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1057.784789] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1057.785281] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.785281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.785450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.785496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.785645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.785744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.785806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.785950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.786044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.786139] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.951156] env[65455]: INFO networking_nsxv3.common.synchronization [req-da4e0e86-9261-44ea-9cd7-8f042a6d17ef req-58d925a3-3913-4350-9c35-72308edd281b service nova] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1057.951156] env[65455]: INFO networking_nsxv3.common.synchronization [req-da4e0e86-9261-44ea-9cd7-8f042a6d17ef req-58d925a3-3913-4350-9c35-72308edd281b service nova] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1057.951289] env[65455]: INFO networking_nsxv3.common.synchronization [req-da4e0e86-9261-44ea-9cd7-8f042a6d17ef req-58d925a3-3913-4350-9c35-72308edd281b service nova] Enqueued Resource ID: 599f68a1-ce79-47d3-8b54-0d500b742489 with Priority: HIGHEST for action port [ 1057.951801] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_rules [ 1057.951931] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1057.952920] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599f68a1-ce79-47d3-8b54-0d500b742489 with Priority: HIGHEST for action port [ 1057.953283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.953412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.953489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.953693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.953789] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.955163] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.955286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.955372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.955554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.956066] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.957093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.957093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.957093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.957093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.957093] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.957983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-599f68a1-ce79-47d3-8b54-0d500b742489 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.958100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.958167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.958328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.958475] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('599f68a1-ce79-47d3-8b54-0d500b742489',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.023700] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.023942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.024120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.024444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.024608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.024783] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1058.071670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.071877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.071981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.072279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.072477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.084959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1058.288032] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.460065] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.460300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.460546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 599f68a1-ce79-47d3-8b54-0d500b742489 with status ACTIVE [ 1058.460856] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.460974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.461050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.461277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.461365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.461540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.461633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.461691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.461848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.461925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.462127] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.462226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.462302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.462476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.462558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.462645] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 599f68a1-ce79-47d3-8b54-0d500b742489 is going to be updated. [ 1058.464346] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.489360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.489506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.489582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.489788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.489954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.490209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-599f68a1-ce79-47d3-8b54-0d500b742489" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.793784] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.966755] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.016791] env[65455]: INFO networking_nsxv3.common.synchronization [req-b9ccc4d6-24ba-4f1f-a5c1-de1c725ee0f6 req-d40b1629-0513-4cc9-b2a9-376a57af8b25 tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1059.017952] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1059.018384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.018511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.018580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.018863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.019117] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.019225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.019281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.019456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.019545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.019646] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.296553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.298022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.298022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.298022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.298022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.298022] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1059.331356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.331356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.331356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.331528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.331604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.341147] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1059.394253] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-667 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.394253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.394253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.394253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.394253] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.394253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.394253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.395364] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.395540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.395758] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.395876] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.395987] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.396114] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.397133] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.397282] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.397429] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.414590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.414768] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.414910] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.415102] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-667" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.415413] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.415629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.415697] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.416038] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.416177] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b866d86-2cab-4b5a-a3ba-7f9d87aca42c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.470667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.470889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.470959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.471233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.471480] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 is going to be created. [ 1059.498981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.499216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.499314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.500096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.500096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.515825] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: UNINITIALIZED for 2s [ 1059.522533] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.522704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.522779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.523030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.523166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.523616] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.523682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.523725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.524221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.524321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.524439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 already deleted. [ 1059.524546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.919250] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.919569] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.919693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.919980] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.920153] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.920338] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c not found, creating... [ 1059.920656] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.920821] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.920939] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.921190] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.921329] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.921615] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.921765] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.921879] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.922107] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.922241] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.922380] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c is going to be created. [ 1059.947066] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.947066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.947407] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.947521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.947766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.948014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.098189] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1060.098551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.099017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.100187] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.100187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.100553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.100553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.100553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.100698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.100833] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.100966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.101023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.101134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.101243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.101302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.101401] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.604489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ac3b58e-d195-4a17-8ba8-c2865a1a218d: rpc.has_security_group_logging(os_id): False [ 1060.624093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.624271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.624340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.624540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.624637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.624810] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.624906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.624969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625432] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.625512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.625552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.625829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.625829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.625986] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.625986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.626099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.626198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.626265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.626607] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1060.673009] env[65455]: INFO networking_nsxv3.common.synchronization [req-b9ccc4d6-24ba-4f1f-a5c1-de1c725ee0f6 req-cef7336a-dc14-41e4-b326-5620af72e431 service nova] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1060.673214] env[65455]: INFO networking_nsxv3.common.synchronization [req-b9ccc4d6-24ba-4f1f-a5c1-de1c725ee0f6 req-cef7336a-dc14-41e4-b326-5620af72e431 service nova] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1060.673349] env[65455]: INFO networking_nsxv3.common.synchronization [req-b9ccc4d6-24ba-4f1f-a5c1-de1c725ee0f6 req-cef7336a-dc14-41e4-b326-5620af72e431 service nova] Enqueued Resource ID: 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c with Priority: HIGHEST for action port [ 1060.674963] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_rules [ 1060.675784] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1060.675916] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c with Priority: HIGHEST for action port [ 1060.676271] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.676345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.676442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.676633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.676711] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.677884] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.678010] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.678083] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.678260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.678403] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.678498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.678557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.678690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.678769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.679830] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.680073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.680073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.680253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.680293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.680341] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b866d86-2cab-4b5a-a3ba-7f9d87aca42c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.692530] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.692729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.692729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.692917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.693085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.708637] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1061.181825] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.182875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.182954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.183111] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c with status ACTIVE [ 1061.183259] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.183417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.183417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184213] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.184213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.184213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.184490] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.184569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.184602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.184747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.184922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.185028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b866d86-2cab-4b5a-a3ba-7f9d87aca42c is going to be updated. [ 1061.207889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.208073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.208129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.208325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.208452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.208626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b866d86-2cab-4b5a-a3ba-7f9d87aca42c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.254213] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.254382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.254452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.254694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.254872] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.352988] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1061.353241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.527982] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: SUCCESS [ 1061.528240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.528441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.528698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.528968] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.529132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.529191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.529370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.529481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.529579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.529673] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.687056] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.758488] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.032066] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.189220] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.189545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.189545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.189717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.189863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.190049] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 is going to be created. [ 1062.217532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.217749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.217749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.217949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.218130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.231782] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: UNINITIALIZED for 2s [ 1062.261320] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.535386] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c05eda9-c2f4-442b-be6e-f7bc8787f553: rpc.has_security_group_logging(os_id): False [ 1062.557020] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.557242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.557242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.557462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.557566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.557796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.557895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.557958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.558127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.558204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.558326] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 is going to be created. [ 1062.652985] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.653215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.653215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.653639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.653639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.668286] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: IN_PROGRESS for 2s [ 1062.729342] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1062.729486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.730369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.730528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.730876] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.763313] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1062.763455] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1062.905795] env[65455]: INFO networking_nsxv3.common.synchronization [req-c8a629b5-cfa8-4e47-872a-f361e38ef423 req-510b6b24-845e-4bf8-8e3c-0796ccd33bb4 tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1062.908640] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1062.908640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.908640] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.908640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.908640] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.181024] env[65455]: INFO networking_nsxv3.common.synchronization [req-5f1df17c-a44b-4195-9478-7d1672711eaa req-f45ba279-d355-441f-9e24-5cd3a577d999 tempest-MultipleCreateTestJSON-1711654768 tempest-MultipleCreateTestJSON-1711654768-project-member] Enqueued Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1063.185554] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d with Priority: HIGHEST for action security_group_members [ 1063.185885] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.186049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.233538] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.233930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.411100] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.761179] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.761418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.761418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.761613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.774991] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1063.775873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.776811] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1063.824431] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.824686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.824686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.824854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.835295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.836021] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1063.836126] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1063.836187] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1063.886454] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.886705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.886705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.886906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.888557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888683] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1063.915735] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.015130] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.015287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.015547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.015621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.015839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.016145] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1064.114111] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.114270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.114332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.114617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.114909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.115256] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1064.115415] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2d88d984-b158-405e-922b-bf70bddac6ef', '063ecd4f-5a85-4f8d-9ca3-d7222690dd83', '6fe6dc0e-8a36-4463-aa2a-12b94566760c', 'a1da3b0d-71fb-478a-9ca1-c921e2456e4b', '9354847f-0991-42fd-9b0e-3a2865fde47c', '8c69e1d2-094e-4ac7-ba40-034e34e6a1e9', 'fadf75a5-9161-4bdb-8e45-26618ca6c5ea', 'ea5c289d-af02-4d2b-a1c6-0622c1d1d251', '42a8d0a2-99ce-4c84-bb03-a9bf686e0924', '729b41b0-b42f-49a0-b406-fc5850b09cf6', '34d06a71-fbe2-479a-842a-9891893495e3', '2391e1ec-f04f-463f-aaa0-77abb954955b', '06a1d99f-1f74-4491-ba68-95d6af0beb2a', 'c376506d-a918-477c-96df-60ae10c0bcb8', '26ed7fa4-c041-48e3-8d4c-2e341fddd4b5', 'f478263e-cdfa-466c-b468-3760ea97e6b8', '45b5142c-4bc9-41fd-a039-af08feb308fd', '5dc78c59-d8d2-4264-8e48-80b9a24879c5', '0cfb754e-de2d-4baa-bb6c-0888418311d4', 'd2645787-f0c6-445b-afb0-d7c9acc45e6c', '5d835a6b-ad66-42cb-9c87-a0b00ea650f8', '96905b57-3285-43c8-99f7-2f66d28aafa1', 'cfc86584-6c08-4a39-8d62-18bde1a7dd9d', '0a198777-edb2-486c-96fc-27aa5daf59ad', 'c8ac4b88-966c-4479-95d3-80b154d92475', '8f01b182-5b01-4e49-8f70-13d804029019', 'e637b5c5-e399-481c-982c-2851963e7c48', 'f8950d72-cdfa-4b89-babf-49c50bce2b96', '2bcfe12f-28f7-472c-8e5a-1f4d45ae689c', '5c05eda9-c2f4-442b-be6e-f7bc8787f553', 'e805e5ac-07cc-4195-97d9-60139abf3cc5', '3313b461-f39b-4336-888c-410e1a4217c0', '50ff894b-9924-4f71-b210-20859560462d', 'a4a6023d-5c33-4db0-b5c2-37c37091322f', '10c4ff11-5e8b-4540-903a-abb548417d57', 'de94ae8c-64b4-4119-bf51-89a5595f402a', '6ac3b58e-d195-4a17-8ba8-c2865a1a218d', 'daa747c9-bcaa-4016-b259-ce693108d0ee', 'a18e5b54-8a6d-4a7c-985e-7a6963e15109', '4e9d5580-b38c-4840-86f0-a6cc8d6dbd99', 'd70687e5-a5c2-4fcd-8aab-9c7e15c186ed', '38ce0832-87af-446e-9ffb-4cf08e497970', 'a0ddf7c7-f7d9-457a-834f-979355b01964', 'a86ef01d-dc8d-4d53-89c0-62ea8aeb7720', '07680d19-56f1-4d34-ab9f-26b0ad63d370'} {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.115415] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1064.138544] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.138768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.138768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.139122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.139195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.139314] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1064.139513] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.139513] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1064.246380] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: SUCCESS [ 1064.246713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.247076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.247395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.247645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.247908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.247908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.248162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.248162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.248389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.248622] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.263283] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.263516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.263516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.263760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.264782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.265106] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1064.265197] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1064.265271] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1064.265339] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1064.265421] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1064.265483] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 1064.265563] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGH for action security_group_rules [ 1064.265621] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGH for action security_group_rules [ 1064.265679] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGH for action security_group_rules [ 1064.265742] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGH for action security_group_rules [ 1064.265812] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGH for action security_group_rules [ 1064.265877] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGH for action security_group_rules [ 1064.265932] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGH for action security_group_rules [ 1064.266046] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGH for action security_group_rules [ 1064.266046] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGH for action security_group_rules [ 1064.266147] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGH for action security_group_rules [ 1064.266147] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGH for action security_group_rules [ 1064.266213] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGH for action security_group_rules [ 1064.266276] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGH for action security_group_rules [ 1064.266324] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGH for action security_group_rules [ 1064.266372] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGH for action security_group_rules [ 1064.266422] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGH for action security_group_rules [ 1064.266477] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGH for action security_group_rules [ 1064.266529] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGH for action security_group_rules [ 1064.266587] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGH for action security_group_rules [ 1064.266683] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.418478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.418478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.418478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.418478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.418478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.418478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1064.451058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.451328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.451328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.451634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.451816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.461644] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1064.751630] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.803718] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: SUCCESS [ 1064.803842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.254477] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0dd971a-8f02-4975-999f-f65b11c26fc9: rpc.has_security_group_logging(os_id): False [ 1065.280439] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.280642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.280689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.280926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.281054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.281422] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.281571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.281670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.281867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.281974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.282097] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 is going to be created. [ 1065.362382] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.362535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.362612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.362817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.362996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.375995] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: IN_PROGRESS for 2s [ 1065.994675] env[65455]: INFO networking_nsxv3.common.synchronization [req-cd2cd22e-99eb-4cb6-8ba6-35778927f96b req-18b9e4a7-653a-4603-b5be-caefdde2edde tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1065.995373] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1065.995459] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 1065.995580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c with Priority: HIGH for action security_group_rules [ 1065.995682] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea with Priority: HIGH for action security_group_rules [ 1065.995780] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 with Priority: HIGH for action security_group_rules [ 1065.995878] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c with Priority: HIGH for action security_group_rules [ 1065.995981] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 with Priority: HIGH for action security_group_rules [ 1065.996612] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGH for action security_group_rules [ 1065.996612] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45b5142c-4bc9-41fd-a039-af08feb308fd with Priority: HIGH for action security_group_rules [ 1065.996612] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGH for action security_group_rules [ 1065.996612] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGH for action security_group_rules [ 1065.996866] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGH for action security_group_rules [ 1065.996866] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGH for action security_group_rules [ 1065.996866] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGH for action security_group_rules [ 1065.996982] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 with Priority: HIGH for action security_group_rules [ 1065.996982] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 with Priority: HIGH for action security_group_rules [ 1065.997063] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 with Priority: HIGH for action security_group_rules [ 1065.997197] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 with Priority: HIGH for action security_group_rules [ 1065.997290] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGH for action security_group_rules [ 1065.997379] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 with Priority: HIGH for action security_group_rules [ 1065.997469] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b with Priority: HIGH for action security_group_rules [ 1065.997800] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.997947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.998026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.998290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.998461] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.998564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.998627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.998789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.998873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.999068] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.000693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.000921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.000921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.001195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.001283] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.003029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.003123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.003181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.003370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.004032] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6fe6dc0e-8a36-4463-aa2a-12b94566760c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.004501] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.005726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.005726] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.006139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.006259] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fadf75a5-9161-4bdb-8e45-26618ca6c5ea',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.008053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.008053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.008053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.008053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.008053] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ed7fa4-c041-48e3-8d4c-2e341fddd4b5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.011905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.012055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.012115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.012298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.012379] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2645787-f0c6-445b-afb0-d7c9acc45e6c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.013487] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cfb754e-de2d-4baa-bb6c-0888418311d4 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.013487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.013487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.013787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.013787] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cfb754e-de2d-4baa-bb6c-0888418311d4',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.015963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.016131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.016203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.016406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.016465] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.019493] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45b5142c-4bc9-41fd-a039-af08feb308fd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.019493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.019493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.019493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.019493] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45b5142c-4bc9-41fd-a039-af08feb308fd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.020139] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.020321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.020401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.020591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.020673] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.022639] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.022807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.022807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.023021] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.023106] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.025313] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.027293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.027293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.027293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.027293] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.028116] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.028230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.028306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.028494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.028572] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.030243] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.030365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.030411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.030597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.030690] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.031982] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-729b41b0-b42f-49a0-b406-fc5850b09cf6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.032766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.032766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.032766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.032766] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('729b41b0-b42f-49a0-b406-fc5850b09cf6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.033591] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.033707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.033707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.033837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.033909] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a8d0a2-99ce-4c84-bb03-a9bf686e0924',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.035472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.035591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.035659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.035825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.035904] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c69e1d2-094e-4ac7-ba40-034e34e6a1e9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.037998] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.037998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.038205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.038331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.038382] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea5c289d-af02-4d2b-a1c6-0622c1d1d251',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.039526] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.039526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.039526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.039728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.039815] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.040956] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.041193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.041285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.041461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.042111] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('063ecd4f-5a85-4f8d-9ca3-d7222690dd83',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.043400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.043877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.043952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.044194] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.044295] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1da3b0d-71fb-478a-9ca1-c921e2456e4b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.050612] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.050840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.050898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.051153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.051394] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.051587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.051661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.052099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.052099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.052099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.052260] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.080979] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.081350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.081350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.081485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.105496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.105672] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6fe6dc0e-8a36-4463-aa2a-12b94566760c is going to be deleted. [ 1066.161513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.161728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.161728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.161931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.162103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.162188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6fe6dc0e-8a36-4463-aa2a-12b94566760c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.474589] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1066.474993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.475149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.475457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.475731] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.475908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.475993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.476225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.476395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.476570] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.501326] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.519206] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.519377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.519490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.519609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.519769] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.519869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.519935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.520269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.520449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.520449] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.520578] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.523596] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.523776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.523884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.524807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.525056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.525404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.525404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.525508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.525581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.525699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.525883] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.533500] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.534285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.534370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.534559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.534735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.534834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.534896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.535162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.535162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.535309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.535309] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.541485] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.542527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.542638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.542794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.544415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.544728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.548340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.548340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.548340] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.551536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.551873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.551873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.552113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.552278] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.552397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.552509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.552627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.553063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.553165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.555939] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.558638] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.558728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.558781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.559652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.559652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.560025] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.560687] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.560792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.560878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.561051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.561175] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.561310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.561360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.561465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.561545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.561639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.561705] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.571150] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.598053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.598224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.611094] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.611332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.612288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.612406] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ed7fa4-c041-48e3-8d4c-2e341fddd4b5 is going to be deleted. [ 1066.614419] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.614419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.614419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.614626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.615857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.615961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.616734] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.616830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.617582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.617675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.618361] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.618453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.619244] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.619333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.620111] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.620232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.644863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.644863] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45b5142c-4bc9-41fd-a039-af08feb308fd is going to be deleted. [ 1066.645893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.645893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.678393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.678534] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a8d0a2-99ce-4c84-bb03-a9bf686e0924 is going to be deleted. [ 1066.680200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.680200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.696051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.696051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.703174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.703541] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fadf75a5-9161-4bdb-8e45-26618ca6c5ea is going to be deleted. [ 1066.704761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.704993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.717386] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.717584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.732404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.732549] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 063ecd4f-5a85-4f8d-9ca3-d7222690dd83 is going to be deleted. [ 1066.733852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.734184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.768320] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.768518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.789144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.789364] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c69e1d2-094e-4ac7-ba40-034e34e6a1e9 is going to be deleted. [ 1066.790263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.790487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.798310] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.798576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.829707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.829865] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2645787-f0c6-445b-afb0-d7c9acc45e6c is going to be deleted. [ 1066.830944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.831186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.927620] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.930116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.962171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.962171] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 729b41b0-b42f-49a0-b406-fc5850b09cf6 is going to be deleted. [ 1066.962782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.963040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.964590] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.964699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.979071] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.979335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.004024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.023262] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.030583] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.030801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.030872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.031478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.031586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.031682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.031863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.031961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.032059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.032250] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.032349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.032409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.032558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.032705] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.032814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.032876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.033240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.033588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.033588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.033588] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.040694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.040694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.040694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.040694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.043551] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.043551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.043551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.043551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.043551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.043551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.043551] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.043833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.045697] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea5c289d-af02-4d2b-a1c6-0622c1d1d251 is going to be deleted. [ 1067.047221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.047492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.057206] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.057550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.057644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.057906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.058211] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.058394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.058527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.058776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.058915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.059156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.059413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.059580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.059689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.059969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.060224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.060471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.060471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.060706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.060889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.061064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.061249] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.066745] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.070957] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.072357] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.074329] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 1067.143537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.143838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.165536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.165771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.171127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.171314] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1da3b0d-71fb-478a-9ca1-c921e2456e4b is going to be deleted. [ 1067.172169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.172426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.181326] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.181545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.211594] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.211893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.317590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.317590] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cfb754e-de2d-4baa-bb6c-0888418311d4 is going to be deleted. [ 1067.318466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.318689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.318784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.318924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ed7fa4-c041-48e3-8d4c-2e341fddd4b5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.319145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.319272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.319348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.319469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45b5142c-4bc9-41fd-a039-af08feb308fd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.320801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.321024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.321121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.321250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a8d0a2-99ce-4c84-bb03-a9bf686e0924" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.321428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.321581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.321655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.321764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fadf75a5-9161-4bdb-8e45-26618ca6c5ea" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.323754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.323964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.324074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-063ecd4f-5a85-4f8d-9ca3-d7222690dd83" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.324498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.324574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c69e1d2-094e-4ac7-ba40-034e34e6a1e9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.324822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.326776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.365169] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.365329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.366291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.366509] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.366703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.366776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.366988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.367110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.367215] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1067.369468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.369468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.369468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.369468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2645787-f0c6-445b-afb0-d7c9acc45e6c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.369832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.369832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.425962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: SUCCESS [ 1067.426236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.455076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.455247] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.455467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.455467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.457463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.457463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.457463] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1067.457463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.457463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.457886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.457886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-729b41b0-b42f-49a0-b406-fc5850b09cf6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.457886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.458058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.458116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.458316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea5c289d-af02-4d2b-a1c6-0622c1d1d251" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.459584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.459773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.459773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.459985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.460142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.461154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.461328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.461425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.462221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1da3b0d-71fb-478a-9ca1-c921e2456e4b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.498325] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.498715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.498715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.498928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.499106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.499447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cfb754e-de2d-4baa-bb6c-0888418311d4" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.500217] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1067.511088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.511336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.511336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.511596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.511753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.511839] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1067.527316] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dc78c59-d8d2-4264-8e48-80b9a24879c5: rpc.has_security_group_logging(os_id): False [ 1067.536729] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c376506d-a918-477c-96df-60ae10c0bcb8: rpc.has_security_group_logging(os_id): False [ 1067.549372] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34d06a71-fbe2-479a-842a-9891893495e3: rpc.has_security_group_logging(os_id): False [ 1067.564403] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9354847f-0991-42fd-9b0e-3a2865fde47c: rpc.has_security_group_logging(os_id): False [ 1067.571874] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06a1d99f-1f74-4491-ba68-95d6af0beb2a: rpc.has_security_group_logging(os_id): False [ 1067.576044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.576044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.576044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.576044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.576827] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f478263e-cdfa-466c-b468-3760ea97e6b8: rpc.has_security_group_logging(os_id): False [ 1067.577655] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2391e1ec-f04f-463f-aaa0-77abb954955b: rpc.has_security_group_logging(os_id): False [ 1067.579423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.579423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.579940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.580059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.619420] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.619621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.625037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.625037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.625037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.625686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.625686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.627456] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.627561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.628373] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.628481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.630559] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.630559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.635516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.635845] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.635978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.636191] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.636422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.636511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.637198] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.637198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.637198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.637198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.637437] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.637437] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.637609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.637609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.637739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.637812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.637923] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 1067.639382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.639538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.641239] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1067.677390] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.677665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.679694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.680150] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.680450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.680536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.680926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.680926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.681050] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 is going to be updated. [ 1067.683303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.683624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.754938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.755324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.755471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.755580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.755762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.755858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.756172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.756280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.756280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.756435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.756522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.756716] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.756796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.756883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.757075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.757157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.757262] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 1067.758439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.758614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.798813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.799099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.800270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.800810] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.800810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.800810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.801107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.801107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.801236] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b is going to be updated. [ 1067.802409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.802761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.819807] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.820036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.845070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.845453] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.845581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.845581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.845810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.845852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.846061] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.846170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.846239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.846392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.846456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.846653] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.846733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.846793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.847020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.847176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.847229] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1067.848293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.849405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.872760] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.872760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.901069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.901069] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.901069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.901069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.901069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.901360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.901360] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1067.902461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.902646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.902814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.903787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.903973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.904137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.905105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.905292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.905416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.906367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.906545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.936030] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1067.941543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 1067.943587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.943755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.946029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: IN_PROGRESS for 2s [ 1067.977741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.978195] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.978385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.978490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.978746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.978858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.979092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a is going to be updated. [ 1067.980714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.981036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.981223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.982587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.982821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.983035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.985578] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.985864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.985864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.986221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.986356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.056064] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 1068.056951] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: IN_PROGRESS for 2s [ 1068.057564] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1068.071440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.071722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.071864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.072208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.072460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.146748] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1068.165060] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.165215] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.165272] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.165500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.165649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.189638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: IN_PROGRESS for 2s [ 1068.290800] env[65455]: INFO networking_nsxv3.common.synchronization [req-a645509a-30aa-44d0-84f6-1a9399f5a4dd req-9736be87-5202-44d7-b9bb-6168ad4ab894 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1068.291487] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1068.291902] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.292030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.292030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.292219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.292493] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.292493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.292661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.292661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.292926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.292926] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.797037] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.300184] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.510418] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1069.510599] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d deletion is rescheduled due to dependency. [ 1069.510747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.510924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.511180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.511384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.511500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.511563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.511736] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.511818] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.511922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.512040] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.653496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1069.653710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.806782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.807172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.807172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.807300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.807377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.807469] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 1069.836329] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.836506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.836506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.837018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.837018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.847528] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 1069.958511] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1069.958727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.960907] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: SUCCESS [ 1069.961159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.963745] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 1069.963745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.015589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.015761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.015833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.016072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.016311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.016428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.016494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.016682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.016784] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.016852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.017093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.017206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.017269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.017514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.017585] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.017639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.017688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.017823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.017910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.018015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.018095] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ac3b58e-d195-4a17-8ba8-c2865a1a218d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.072636] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 1070.072866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.073588] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: SUCCESS [ 1070.073797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.074783] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1070.074946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.163940] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1070.164210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.205198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: SUCCESS [ 1070.205498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.520983] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ac3b58e-d195-4a17-8ba8-c2865a1a218d: rpc.has_security_group_logging(os_id): False [ 1070.543180] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.543388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.543456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.543706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.543815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.544054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.544177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.544241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.544484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.544594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.544811] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.544922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.544989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.545175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.545264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.545503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.545639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.545708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.545836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.545931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.546039] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d is going to be updated. [ 1070.610820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.611036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.611087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.612065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.612065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.626962] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: IN_PROGRESS for 2s [ 1071.858143] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 1071.858518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.644616] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ac3b58e-d195-4a17-8ba8-c2865a1a218d in Status: SUCCESS [ 1072.644616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ac3b58e-d195-4a17-8ba8-c2865a1a218d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.071074] env[65455]: INFO networking_nsxv3.common.synchronization [req-1a6133a6-fb07-4c69-a269-6060c3c490ed req-aaeccd01-8ac2-44e1-a708-1e555d9044d2 tempest-DeleteServersTestJSON-538771272 tempest-DeleteServersTestJSON-538771272-project-member] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1073.071929] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGHEST for action security_group_members [ 1073.072360] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.072426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.072464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.072651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.072838] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.072909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.072994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.073168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.073255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.073349] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.576064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.576232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.576304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.576700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.598189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.598402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.598521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.598610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.598794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.598877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.598972] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be updated. [ 1073.633496] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.633668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.633771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.634034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.634226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.643437] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: IN_PROGRESS for 2s [ 1073.696734] env[65455]: INFO networking_nsxv3.common.synchronization [req-d266b7b4-4bbb-4f8e-b91c-0badddfd319f req-64c10ae5-7aa7-409c-b6d9-569fd6d571c5 tempest-ServersAdminNegativeTestJSON-629033553 tempest-ServersAdminNegativeTestJSON-629033553-project-member] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1073.697073] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGHEST for action security_group_members [ 1073.697376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.697666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.697666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.697811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.697890] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.697983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.698057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.698204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.698289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.698376] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.201040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.201040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.201040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.201529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.201529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.201529] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.201867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.202281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.202281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.202281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.202281] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be updated. [ 1074.232202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.232409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.232409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.232602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.232748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.241718] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: IN_PROGRESS for 2s [ 1075.654084] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 in Status: SUCCESS [ 1075.654521] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 deletion is rescheduled due to dependency. [ 1075.654631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.251812] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34d06a71-fbe2-479a-842a-9891893495e3 in Status: SUCCESS [ 1076.251812] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 deletion is rescheduled due to dependency. [ 1076.251812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.698824] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1078.698824] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1079.768685] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.769064] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.769121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.769371] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.769644] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.769806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.769922] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.770238] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.770386] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.770601] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.770713] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.770822] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.770929] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.771050] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.771161] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.771300] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.799911] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.800169] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.800393] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.800603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.801110] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-513d41bc-8a90-4c39-b15f-300ec148b4d1 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.801344] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.801445] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.801703] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.802071] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513d41bc-8a90-4c39-b15f-300ec148b4d1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.304299] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.304533] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.304653] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.304939] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.305091] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.305387] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.305535] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.305651] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.305864] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.305999] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.306288] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.306450] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.306558] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.306756] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.306889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.307074] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 is going to be updated. [ 1080.329752] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.330097] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.330097] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.330397] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.330597] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.330821] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.023602] env[65455]: INFO networking_nsxv3.common.synchronization [req-499ddee4-5ef6-4bc9-831b-a89f6df2c3b4 req-41710d69-05da-4f07-bab3-cdb290e305bd service nova] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 1081.023602] env[65455]: INFO networking_nsxv3.common.synchronization [req-499ddee4-5ef6-4bc9-831b-a89f6df2c3b4 req-41710d69-05da-4f07-bab3-cdb290e305bd service nova] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 1081.023602] env[65455]: INFO networking_nsxv3.common.synchronization [req-499ddee4-5ef6-4bc9-831b-a89f6df2c3b4 req-41710d69-05da-4f07-bab3-cdb290e305bd service nova] Enqueued Resource ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 with Priority: HIGHEST for action port [ 1081.025233] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_rules [ 1081.025637] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 1081.027472] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 with Priority: HIGHEST for action port [ 1081.027472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.027472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.027472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.027472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.027472] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.031606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.031746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.031814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.032068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.032182] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.032291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.032339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.032492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.032574] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.032667] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.033531] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-513d41bc-8a90-4c39-b15f-300ec148b4d1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.033628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.033691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.033853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.033958] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('513d41bc-8a90-4c39-b15f-300ec148b4d1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.535645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.535831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.536085] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.537103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 513d41bc-8a90-4c39-b15f-300ec148b4d1 with status ACTIVE [ 1081.537292] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.537431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.537509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.537743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.537851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.538056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.538180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.538248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.538436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.538518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.538738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.538861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.538924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.539139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.539229] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.539352] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 513d41bc-8a90-4c39-b15f-300ec148b4d1 is going to be updated. [ 1081.562584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.562814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.562814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.562996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.563143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.563304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-513d41bc-8a90-4c39-b15f-300ec148b4d1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.041651] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.544738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.544738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.545035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.545094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.545227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.545369] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 is going to be updated. [ 1082.582675] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.582935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.582935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.583097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.583230] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.593063] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: IN_PROGRESS for 2s [ 1084.605793] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: SUCCESS [ 1084.606208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.606208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.606415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.606607] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.606722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.606785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.606945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.607025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.607120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.607229] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.657559] env[65455]: INFO networking_nsxv3.common.synchronization [req-ce36745c-e3c5-414f-962a-5c860ddeecd3 req-b05a45c4-6981-435a-a025-df0d51d196e5 tempest-ServersAdminTestJSON-314046162 tempest-ServersAdminTestJSON-314046162-project-member] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1084.657559] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGHEST for action security_group_members [ 1084.659122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.662496] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.662496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.662496] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.110046] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.165000] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.165222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.165284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.165468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.165616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.165844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.165959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.166035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.166211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.166291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.166387] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be updated. [ 1085.198455] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.198627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.198712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.198921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.199038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.208200] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 2s [ 1085.612859] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f01b182-5b01-4e49-8f70-13d804029019: rpc.has_security_group_logging(os_id): False [ 1085.632854] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.633089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.633161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.633402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.654638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.654857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.655048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.655131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.655423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.655533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.655660] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 is going to be updated. [ 1085.727065] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.727381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.727381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.727550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.727676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.742848] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: IN_PROGRESS for 2s [ 1087.221721] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: IN_PROGRESS for 4s [ 1087.759670] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: SUCCESS [ 1087.759916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.670274] env[65455]: INFO networking_nsxv3.common.synchronization [req-8310d6ad-4f5b-4f72-b5a6-a242c42b14e4 req-d43f3de7-53e7-4915-aba6-ba67c2bf1f68 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1088.670274] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1088.670859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.670952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.670952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.671165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.671323] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.671430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.671534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.671741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.671741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.671846] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.044382] env[65455]: INFO networking_nsxv3.common.synchronization [req-3f6f3c22-3da6-409a-a003-b1f983811e86 req-f73d5df0-cd40-4cc6-b9dd-2759d0f646ac tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1089.044479] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1089.044727] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.044857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.044922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.045174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.045501] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.045501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.045501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.045663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.045702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.045787] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.048428] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.048592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.048748] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.049041] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.049834] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.050326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.050326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.050428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.050561] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.050767] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.050879] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.050987] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.051107] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.051216] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.051320] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.051447] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.073124] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.073298] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.073436] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.073614] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.073951] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-cceb36ff-a333-40a8-83ab-e3ec73453202 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.074141] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.074261] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.074602] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.074739] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cceb36ff-a333-40a8-83ab-e3ec73453202',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.174321] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.236121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c376506d-a918-477c-96df-60ae10c0bcb8 in Status: SUCCESS [ 1089.236337] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 deletion is rescheduled due to dependency. [ 1089.236488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.553747] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.553903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.553979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.554236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.579385] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.579649] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.579775] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.580065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.580224] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.580384] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port cceb36ff-a333-40a8-83ab-e3ec73453202 not found, creating... [ 1089.580650] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.580797] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.580909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.581156] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.581290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.581597] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.581746] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.581857] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.582230] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.582375] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.582521] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: cceb36ff-a333-40a8-83ab-e3ec73453202 is going to be created. [ 1089.585069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.585265] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.585367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.585430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.585599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.585674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.585756] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1089.614492] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.614712] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.614838] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.615151] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.615399] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.615636] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.623257] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.623456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.623500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.623964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.624137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.634367] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1089.676153] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.178844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179098] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.179372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.179467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.179570] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1090.218407] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.218549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.218681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.221092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.221092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.231194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1090.368889] env[65455]: INFO networking_nsxv3.common.synchronization [req-8310d6ad-4f5b-4f72-b5a6-a242c42b14e4 req-e0adba05-f444-4e2f-b495-d78b8a8dd2b6 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1090.370019] env[65455]: INFO networking_nsxv3.common.synchronization [req-8310d6ad-4f5b-4f72-b5a6-a242c42b14e4 req-e0adba05-f444-4e2f-b495-d78b8a8dd2b6 service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1090.370019] env[65455]: INFO networking_nsxv3.common.synchronization [req-8310d6ad-4f5b-4f72-b5a6-a242c42b14e4 req-e0adba05-f444-4e2f-b495-d78b8a8dd2b6 service nova] Enqueued Resource ID: cceb36ff-a333-40a8-83ab-e3ec73453202 with Priority: HIGHEST for action port [ 1090.370537] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1090.371343] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1090.371343] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cceb36ff-a333-40a8-83ab-e3ec73453202 with Priority: HIGHEST for action port [ 1090.371343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.371653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.371653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.372323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.372323] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.374224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.374224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.374224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-cceb36ff-a333-40a8-83ab-e3ec73453202 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.374224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.374224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.374838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.374838] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cceb36ff-a333-40a8-83ab-e3ec73453202',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.876373] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.876689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.876731] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cceb36ff-a333-40a8-83ab-e3ec73453202 with status ACTIVE [ 1090.876983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.877231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.877343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.877592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.879740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.879740] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.879740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.879740] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cceb36ff-a333-40a8-83ab-e3ec73453202 is going to be updated. [ 1090.904228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.904454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.904526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.904822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.904996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.905211] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cceb36ff-a333-40a8-83ab-e3ec73453202" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.645106] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1091.645106] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 1091.645106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.253399] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1092.253819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.253819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.254090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.254294] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.254425] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.254487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.254656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.254738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.254834] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.757408] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.967606] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d3e81140-7fb8-4cf7-8a5a-7d34257df87d None None] Enqueued Resource ID: 9488a6d2-1b7f-415f-88ba-031105e66b31 with Priority: HIGHEST for action port [ 1092.967606] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9488a6d2-1b7f-415f-88ba-031105e66b31 with Priority: HIGHEST for action port [ 1092.968290] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9488a6d2-1b7f-415f-88ba-031105e66b31 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.968707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9488a6d2-1b7f-415f-88ba-031105e66b31" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.969071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9488a6d2-1b7f-415f-88ba-031105e66b31" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.969498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9488a6d2-1b7f-415f-88ba-031105e66b31" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.971961] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9488a6d2-1b7f-415f-88ba-031105e66b31',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.260884] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.474297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9488a6d2-1b7f-415f-88ba-031105e66b31 [ 1093.474639] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.476710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.480530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.480530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.480530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.480530] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9488a6d2-1b7f-415f-88ba-031105e66b31 already deleted. [ 1093.480530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9488a6d2-1b7f-415f-88ba-031105e66b31" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.767027] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.767027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.767027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.768071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.768071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.768071] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1093.802515] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.802681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.802754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.802977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.803142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.814393] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1094.618185] env[65455]: INFO networking_nsxv3.common.synchronization [req-3ac27e4d-33e8-496f-8dd8-144a15e2cc22 req-8775be51-27bf-4161-b3cb-6d006a252cbb tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1094.618659] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1094.618922] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.619068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.619148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.619377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.619546] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.619653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.619710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.619840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.619920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.620027] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.098083] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.098289] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.098412] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.099015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.099451] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.099641] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.099762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.099992] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.100147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.100357] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.100484] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.100567] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.100670] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.100977] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.100977] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.101086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.123076] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.123255] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.123405] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.123590] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-550" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.123935] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-9e7173fd-1034-4971-9a93-8d25637f4bf9 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.124132] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.124255] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.124589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.124727] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7173fd-1034-4971-9a93-8d25637f4bf9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.125759] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.125882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.126521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.126951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.127203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.127507] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.127636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.127696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.127970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.128182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.128284] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1095.157547] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.157687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.157749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.157956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.158108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.168289] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1095.369186] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ccc69578-a69e-41aa-8938-b3d18ebb6c51 None None] Enqueued Resource ID: 861a9948-e6c8-4117-96dd-60f56f37c2c9 with Priority: HIGHEST for action port [ 1095.369869] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861a9948-e6c8-4117-96dd-60f56f37c2c9 with Priority: HIGHEST for action port [ 1095.369958] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-861a9948-e6c8-4117-96dd-60f56f37c2c9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.370110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-861a9948-e6c8-4117-96dd-60f56f37c2c9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.370182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-861a9948-e6c8-4117-96dd-60f56f37c2c9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.370463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-861a9948-e6c8-4117-96dd-60f56f37c2c9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.370545] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861a9948-e6c8-4117-96dd-60f56f37c2c9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.630587] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.631015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.631015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.631218] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.631369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.631529] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 9e7173fd-1034-4971-9a93-8d25637f4bf9 not found, creating... [ 1095.631795] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.631952] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.632134] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.632310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.632441] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.632762] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.632964] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.633071] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.633208] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.633334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.633513] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 9e7173fd-1034-4971-9a93-8d25637f4bf9 is going to be created. [ 1095.657826] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.657826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.657826] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.658393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.658393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.658479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.826571] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1095.826830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.827041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.827503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.827631] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.828077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.828077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.828572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.828572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.828572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.828572] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.877778] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 861a9948-e6c8-4117-96dd-60f56f37c2c9 [ 1095.877778] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.877778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.877778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.877778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.877778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.877778] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:861a9948-e6c8-4117-96dd-60f56f37c2c9 already deleted. [ 1095.877778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-861a9948-e6c8-4117-96dd-60f56f37c2c9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.332199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.332199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.332199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.332199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.332199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.332199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.332199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.332606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.332606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.332606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.332606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.332751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.332751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.332836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.332961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.333056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.333113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.333258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.333328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.333404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.333488] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.408406] env[65455]: INFO networking_nsxv3.common.synchronization [req-3ac27e4d-33e8-496f-8dd8-144a15e2cc22 req-2e9bd766-6542-4d59-b05d-4125ff0269d2 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 1096.408566] env[65455]: INFO networking_nsxv3.common.synchronization [req-3ac27e4d-33e8-496f-8dd8-144a15e2cc22 req-2e9bd766-6542-4d59-b05d-4125ff0269d2 service nova] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1096.408707] env[65455]: INFO networking_nsxv3.common.synchronization [req-3ac27e4d-33e8-496f-8dd8-144a15e2cc22 req-2e9bd766-6542-4d59-b05d-4125ff0269d2 service nova] Enqueued Resource ID: 9e7173fd-1034-4971-9a93-8d25637f4bf9 with Priority: HIGHEST for action port [ 1096.409286] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_rules [ 1096.409438] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1096.409539] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e7173fd-1034-4971-9a93-8d25637f4bf9 with Priority: HIGHEST for action port [ 1096.409817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.409992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.409992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.410232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.410337] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.411202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.411308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.411495] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e7173fd-1034-4971-9a93-8d25637f4bf9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.411596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.411977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.411977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.411977] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e7173fd-1034-4971-9a93-8d25637f4bf9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.836022] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 1096.855658] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.855815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.855878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.856870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.881670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.881670] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.881670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.881670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.881943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.882413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.882413] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.882413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.882413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.882640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.882640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.882812] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.882903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.882965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.883205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.883296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.883383] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1096.914533] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.914533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.914812] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e7173fd-1034-4971-9a93-8d25637f4bf9 with status ACTIVE [ 1096.914983] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.915142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.915201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.915373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.915465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.915632] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.915746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.915846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.915978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.916097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.916292] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.916453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.916533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.916711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.916785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.916870] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e7173fd-1034-4971-9a93-8d25637f4bf9 is going to be updated. [ 1096.937862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.938082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.938082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.938307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.938441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.938599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e7173fd-1034-4971-9a93-8d25637f4bf9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.948452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.948452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.948700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.948700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.948842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.973249] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1097.178567] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1097.178741] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 1097.178897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.179312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.179934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.179934] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.180050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.180050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.180276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.180392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.180979] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.683247] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.186093] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.689049] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.689049] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.689399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.689447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.689578] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.689766] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1098.726973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.727276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.727454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.727640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.727870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.740763] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1099.006925] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1099.007217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.092706] env[65455]: INFO networking_nsxv3.common.synchronization [req-9e889e70-68d0-4b8a-9c85-491cf6e76d0d req-b4d0e37e-be6f-4dea-85d0-1cfde6fa8d09 tempest-ServersTestJSON-185825024 tempest-ServersTestJSON-185825024-project-member] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1099.094610] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGHEST for action security_group_members [ 1099.094848] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.094989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.095341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.095341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.095472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.096929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.096929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.096929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.096929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.096929] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.600564] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.600564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.600564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.600564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.632653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.632914] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.633055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.633134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.634389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.634389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.634389] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d is going to be updated. [ 1099.666720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.666869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.666941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.667179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.667588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.680087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: IN_PROGRESS for 2s [ 1100.757961] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1100.759033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.759033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.759033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.759307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.759399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.759850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.759958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.760153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.760330] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.267124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.267124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.267124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.267124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.267124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.268027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.268027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.268027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.268027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.268027] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.312836] env[65455]: INFO networking_nsxv3.common.synchronization [req-9fcb7829-54d3-4b63-9542-7d7e3a2bce19 req-18aa73db-e6ba-4820-aa8c-16f305eb9526 tempest-InstanceActionsTestJSON-1881071793 tempest-InstanceActionsTestJSON-1881071793-project-member] Enqueued Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1101.316093] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1101.316093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.316093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.316093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.316093] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.695609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d in Status: SUCCESS [ 1101.695609] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d deletion is rescheduled due to dependency. [ 1101.695609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.771621] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de94ae8c-64b4-4119-bf51-89a5595f402a: rpc.has_security_group_logging(os_id): False [ 1101.782761] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-841 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.782979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-841" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.783188] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-841" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.783517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-841" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.783794] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.783956] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.784084] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.784315] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.784557] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.784728] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.784922] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.785027] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.785156] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.785334] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.785513] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.785674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.801989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.802173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.802213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.802474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.802618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.802941] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.803071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.803111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.803260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.803341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.803573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.803679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.803817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.803898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.803991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.804201] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.804289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.804370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.804517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.804703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.804703] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1101.811013] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.811013] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.811013] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.811013] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-841" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.811388] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.811623] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.811746] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.812087] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.812295] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c9b59bf-0df7-42bf-ba1d-89b86fe6e769',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.818513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.818513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.818733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.818809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.818852] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.819146] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.819337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.819337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.819503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.819631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.819725] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 already deleted. [ 1101.819810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.861787] env[65455]: INFO networking_nsxv3.common.synchronization [None req-176d3324-9657-4978-822a-4658d4a71139 None None] Enqueued Resource ID: 64766d51-b4c2-4fec-a52d-f2947502b4ae with Priority: HIGHEST for action port [ 1101.862462] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64766d51-b4c2-4fec-a52d-f2947502b4ae with Priority: HIGHEST for action port [ 1101.862785] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-64766d51-b4c2-4fec-a52d-f2947502b4ae taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.862910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64766d51-b4c2-4fec-a52d-f2947502b4ae" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.863166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64766d51-b4c2-4fec-a52d-f2947502b4ae" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.863488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64766d51-b4c2-4fec-a52d-f2947502b4ae" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.863591] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64766d51-b4c2-4fec-a52d-f2947502b4ae',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.076155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.076155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.076155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.076466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.076466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.100090] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1102.314800] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.315056] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.346425] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 not found, creating... [ 1102.346425] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.346425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.346425] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.346909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.346909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.346909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.346909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.346909] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 is going to be created. [ 1102.366394] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64766d51-b4c2-4fec-a52d-f2947502b4ae [ 1102.366642] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.366786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.366871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.367156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.367285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.367400] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64766d51-b4c2-4fec-a52d-f2947502b4ae already deleted. [ 1102.367489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64766d51-b4c2-4fec-a52d-f2947502b4ae" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.373593] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.373952] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.374201] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.374647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.375023] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.375490] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.794948] env[65455]: INFO networking_nsxv3.common.synchronization [req-7946a332-65af-48c0-a741-ed0262cc077f req-88af5169-8b5f-4579-8ff6-a0431a649492 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1102.796282] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1102.798036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.799195] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.799195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.799195] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.069435] env[65455]: INFO networking_nsxv3.common.synchronization [req-9fcb7829-54d3-4b63-9542-7d7e3a2bce19 req-8d1db5d4-ee61-43cd-9f6e-139f5aa6cffb service nova] Enqueued Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_rules [ 1103.069671] env[65455]: INFO networking_nsxv3.common.synchronization [req-9fcb7829-54d3-4b63-9542-7d7e3a2bce19 req-8d1db5d4-ee61-43cd-9f6e-139f5aa6cffb service nova] Enqueued Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1103.069829] env[65455]: INFO networking_nsxv3.common.synchronization [req-9fcb7829-54d3-4b63-9542-7d7e3a2bce19 req-8d1db5d4-ee61-43cd-9f6e-139f5aa6cffb service nova] Enqueued Resource ID: 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 with Priority: HIGHEST for action port [ 1103.070611] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_rules [ 1103.070759] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1103.070849] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 with Priority: HIGHEST for action port [ 1103.071144] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.071266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.071332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.071613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.071704] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.074178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.074288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.074355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.074535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.074693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.074775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.074835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.074976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.075076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.075853] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.075964] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.076723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.076723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.076723] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.076723] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c9b59bf-0df7-42bf-ba1d-89b86fe6e769',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.301960] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.487826] env[65455]: INFO networking_nsxv3.common.synchronization [req-cd8c70d4-f6fd-471b-bcf4-bef056f6132e req-11c3f6de-174e-4ee3-bfd2-172f35730b31 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1103.488691] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1103.490134] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.491653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.491653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.491653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.491653] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.491873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.491873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.492373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.492373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.492373] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.565755] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d99f3301-91f0-4266-be6b-1ae8d769dc4d tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1103.566338] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1103.566667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.566812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.566881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.569450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.569450] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.578517] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.578684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.579810] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.580221] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 with status ACTIVE [ 1103.580424] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.580538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.580623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.580908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.580959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.581540] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.581540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.581540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.581540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.581755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.581809] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.582734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.582734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.582734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.582734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.582734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c9b59bf-0df7-42bf-ba1d-89b86fe6e769 is going to be updated. [ 1103.618434] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.618691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.619128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.619488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.619819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.620015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c9b59bf-0df7-42bf-ba1d-89b86fe6e769" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.755683] env[65455]: INFO networking_nsxv3.common.synchronization [None req-506c05ce-220d-4c30-83a9-a691f03007d5 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1103.756324] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1103.756559] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.756679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.804454] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.874187] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.874187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.874187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.874187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.874187] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.874187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.874187] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.874691] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.874965] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.875334] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.875591] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.875783] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.875965] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.876239] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1103.876439] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.876734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.918568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.918568] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1103.918568] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.918568] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.920033] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-3349ff39-a381-405e-8dcb-732863a1a3dd taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.920033] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.920033] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.920033] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.920033] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3349ff39-a381-405e-8dcb-732863a1a3dd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.995471] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.995471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.995471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.995731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.995824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.996052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.996152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.996185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.996363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.996842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.996842] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 already deleted. [ 1103.996842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.085190] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.103864] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.104123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.104123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.104364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.104921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.105129] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc405b2-4121-462f-8527-3f4dc420de69 already deleted. [ 1104.105262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.105858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.106124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.106253] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.132484] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1104.132767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.308526] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.308526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.308526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.308526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.308526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.308526] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1104.347699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.347699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.347699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.347699] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.347910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.360776] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1104.400440] env[65455]: INFO networking_nsxv3.common.synchronization [None req-60f3e31f-10a4-4b13-acee-f02dd8258e36 None None] Enqueued Resource ID: fc51e60a-1a93-47a8-bdfe-0a126f38cc93 with Priority: HIGHEST for action port [ 1104.402166] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc51e60a-1a93-47a8-bdfe-0a126f38cc93 with Priority: HIGHEST for action port [ 1104.402654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc51e60a-1a93-47a8-bdfe-0a126f38cc93 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.403126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc51e60a-1a93-47a8-bdfe-0a126f38cc93" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.403126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc51e60a-1a93-47a8-bdfe-0a126f38cc93" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.403317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc51e60a-1a93-47a8-bdfe-0a126f38cc93" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.403414] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc51e60a-1a93-47a8-bdfe-0a126f38cc93',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.422840] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.423378] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.423378] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.424711] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.424711] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.424711] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 3349ff39-a381-405e-8dcb-732863a1a3dd not found, creating... [ 1104.424711] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.424711] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.424711] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.425100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.425100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.425193] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.425378] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.425507] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.425766] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.425920] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.426411] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 3349ff39-a381-405e-8dcb-732863a1a3dd is going to be created. [ 1104.465535] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.465809] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.465960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.466291] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.466578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.466895] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.590023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.590233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.590338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.590637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.590766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.591352] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 is going to be created. [ 1104.651888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.652077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.652161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.652458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.652588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.652712] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc405b2-4121-462f-8527-3f4dc420de69 already deleted. [ 1104.652812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.697755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.697971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.697971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.698214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.698390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.722478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: UNINITIALIZED for 2s [ 1104.907722] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc51e60a-1a93-47a8-bdfe-0a126f38cc93 [ 1104.909067] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.909067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.909067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.909242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.909242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.909401] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc51e60a-1a93-47a8-bdfe-0a126f38cc93 already deleted. [ 1104.909549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc51e60a-1a93-47a8-bdfe-0a126f38cc93" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.176343] env[65455]: INFO networking_nsxv3.common.synchronization [req-cd8c70d4-f6fd-471b-bcf4-bef056f6132e req-616b0f61-56a0-4730-b35d-4634caf3f4f4 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1105.176521] env[65455]: INFO networking_nsxv3.common.synchronization [req-cd8c70d4-f6fd-471b-bcf4-bef056f6132e req-616b0f61-56a0-4730-b35d-4634caf3f4f4 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1105.176780] env[65455]: INFO networking_nsxv3.common.synchronization [req-cd8c70d4-f6fd-471b-bcf4-bef056f6132e req-616b0f61-56a0-4730-b35d-4634caf3f4f4 service nova] Enqueued Resource ID: 3349ff39-a381-405e-8dcb-732863a1a3dd with Priority: HIGHEST for action port [ 1105.178326] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1105.178449] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1105.178651] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3349ff39-a381-405e-8dcb-732863a1a3dd with Priority: HIGHEST for action port [ 1105.178926] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.179152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.179241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.179517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.179937] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.181112] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.182600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.182688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.182930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.183134] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.183279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.183399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.183621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.183892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.183892] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.185182] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-3349ff39-a381-405e-8dcb-732863a1a3dd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.185350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.185436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.185659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.185779] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3349ff39-a381-405e-8dcb-732863a1a3dd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.692402] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3349ff39-a381-405e-8dcb-732863a1a3dd with status ACTIVE [ 1105.693317] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.693317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.693317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.693317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.693518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.693626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.693735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.693799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.693967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.694055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.694236] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.694328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.694389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.694525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.694601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.694682] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3349ff39-a381-405e-8dcb-732863a1a3dd is going to be updated. [ 1105.697238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.697355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.698096] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.723384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.723384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.723384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.723384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.723384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.723559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3349ff39-a381-405e-8dcb-732863a1a3dd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.203035] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.387756] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1106.387756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.705870] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.706047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.706122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.706484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.706484] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.706610] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be created. [ 1106.734098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: SUCCESS [ 1106.734273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.734429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.734667] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.734858] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.734976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.735052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.735206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.735294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.735465] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.738272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.738407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.738539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.738711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.738815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.750044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: UNINITIALIZED for 2s [ 1107.242238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.242238] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.242238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.242721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.242721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.242721] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.242721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.242721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.242856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.243202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.243202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.243202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.243202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.243339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.243339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.243415] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.745439] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8cab38d-b4ee-4298-97b3-e8115ab313d7: rpc.has_security_group_logging(os_id): False [ 1107.764087] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.764290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.764362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.764577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.764662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.764922] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.765060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.765119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.765334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.765421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.765536] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.765629] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.765681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.765850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.765998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.766210] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.766210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.766371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.766426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.766475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.766587] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 is going to be created. [ 1107.836852] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.837109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.837109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.837396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.837579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.852705] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: IN_PROGRESS for 2s [ 1108.764013] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1108.764363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.764479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.764798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.765026] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.765181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.765265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.765510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.765638] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.765752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.765849] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.113747] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6a1898f5-e7e4-4015-a4b2-2847f5265016 None None] Enqueued Resource ID: 5204da35-eac2-4e9d-8b93-a3b585dfaae1 with Priority: HIGHEST for action port [ 1109.116111] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5204da35-eac2-4e9d-8b93-a3b585dfaae1 with Priority: HIGHEST for action port [ 1109.116111] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5204da35-eac2-4e9d-8b93-a3b585dfaae1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.116111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5204da35-eac2-4e9d-8b93-a3b585dfaae1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.116111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5204da35-eac2-4e9d-8b93-a3b585dfaae1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.117517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5204da35-eac2-4e9d-8b93-a3b585dfaae1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.117517] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5204da35-eac2-4e9d-8b93-a3b585dfaae1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.272364] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.272569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.272639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.272824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.272988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.273197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.273284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.273445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.273576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.273695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.273849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.273940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.274008] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.274161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.274301] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.274393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.274455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.274590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.274675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.274771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.274891] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.621510] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5204da35-eac2-4e9d-8b93-a3b585dfaae1 [ 1109.621748] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.621879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.621948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.622187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.622275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.622370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5204da35-eac2-4e9d-8b93-a3b585dfaae1 already deleted. [ 1109.622454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5204da35-eac2-4e9d-8b93-a3b585dfaae1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.778462] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba484ae0-86ee-48da-8cfe-e1829ca57af5: rpc.has_security_group_logging(os_id): False [ 1109.804443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.804620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.804767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.804944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.804944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.805184] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.805281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.805331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.805491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.805566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.806170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.806170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.806170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.806170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.806414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.806414] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.806557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.806600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.806713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.806787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.808189] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be created. [ 1109.868410] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: SUCCESS [ 1109.868605] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.876045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.876186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.876274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.876512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.876707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.893805] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1110.887587] env[65455]: INFO networking_nsxv3.common.synchronization [req-699d8d00-33f9-42b5-a0f4-aef61359871e req-7a2ccca1-935b-4044-997a-e18b5394de41 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1110.887587] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1110.887868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.887982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.888368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.888663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.888862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.889276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.889276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.889276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.889454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.889508] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.251672] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.251889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.252021] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.252374] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.252639] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.252825] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.252900] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.254591] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.254776] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.255039] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.255145] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.255258] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.255367] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.255486] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.255619] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.255734] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.276309] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.276521] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.277029] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.277029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.277353] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-52bd603c-1fc5-4e3b-a554-011984165618 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.277779] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.277779] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.278084] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.278223] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52bd603c-1fc5-4e3b-a554-011984165618',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.392645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.392991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.392991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.393122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.393233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.393452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.393556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.393616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.393923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.393923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.393923] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 already deleted. [ 1111.394044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.451250] env[65455]: INFO networking_nsxv3.common.synchronization [req-4e7f0d1d-1f70-45c0-bb5a-82c94ef952ae req-56f8453e-2773-4c53-8f24-d8f317c008af tempest-ServerDiskConfigTestJSON-599122988 tempest-ServerDiskConfigTestJSON-599122988-project-member] Enqueued Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1111.451847] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de94ae8c-64b4-4119-bf51-89a5595f402a with Priority: HIGHEST for action security_group_members [ 1111.452200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-de94ae8c-64b4-4119-bf51-89a5595f402a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.452343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.452402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.452898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.452898] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.452898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.452898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.453058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.453171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.453211] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de94ae8c-64b4-4119-bf51-89a5595f402a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.633665] env[65455]: INFO networking_nsxv3.common.synchronization [None req-1975d6ce-3702-4d4b-94d9-e1c77e57f96e None None] Enqueued Resource ID: d8625309-5d98-4712-bfd9-9bae43c3d0b1 with Priority: HIGHEST for action port [ 1111.634846] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8625309-5d98-4712-bfd9-9bae43c3d0b1 with Priority: HIGHEST for action port [ 1111.635207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8625309-5d98-4712-bfd9-9bae43c3d0b1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.635356] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8625309-5d98-4712-bfd9-9bae43c3d0b1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.635431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8625309-5d98-4712-bfd9-9bae43c3d0b1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.635695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8625309-5d98-4712-bfd9-9bae43c3d0b1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.635795] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8625309-5d98-4712-bfd9-9bae43c3d0b1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.780658] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.780806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.781675] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.781675] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.781675] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.781675] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 52bd603c-1fc5-4e3b-a554-011984165618 not found, creating... [ 1111.781902] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.782057] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.782259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.782456] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.782592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.782883] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.783062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.783176] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.783394] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.783524] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.783659] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 52bd603c-1fc5-4e3b-a554-011984165618 is going to be created. [ 1111.806344] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.806510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.806545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.806812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.807138] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.807358] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.913827] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1111.914140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.956251] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.956511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.956641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.956929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.957084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.957405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.957560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.957734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.957925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.958115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.958266] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a is going to be updated. [ 1112.015322] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.015479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.015554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.015775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.015925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.025086] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: IN_PROGRESS for 2s [ 1112.138543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8625309-5d98-4712-bfd9-9bae43c3d0b1 [ 1112.138782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.138916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.138989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.139234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.139434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.139539] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8625309-5d98-4712-bfd9-9bae43c3d0b1 already deleted. [ 1112.139626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8625309-5d98-4712-bfd9-9bae43c3d0b1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.538545] env[65455]: INFO networking_nsxv3.common.synchronization [req-699d8d00-33f9-42b5-a0f4-aef61359871e req-4ce8985c-1b35-49ad-87eb-e724a27076ed service nova] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1112.538758] env[65455]: INFO networking_nsxv3.common.synchronization [req-699d8d00-33f9-42b5-a0f4-aef61359871e req-4ce8985c-1b35-49ad-87eb-e724a27076ed service nova] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1112.538908] env[65455]: INFO networking_nsxv3.common.synchronization [req-699d8d00-33f9-42b5-a0f4-aef61359871e req-4ce8985c-1b35-49ad-87eb-e724a27076ed service nova] Enqueued Resource ID: 52bd603c-1fc5-4e3b-a554-011984165618 with Priority: HIGHEST for action port [ 1112.539611] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1112.539747] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1112.539865] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52bd603c-1fc5-4e3b-a554-011984165618 with Priority: HIGHEST for action port [ 1112.540184] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.540339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.540384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.540642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.540725] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.541630] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.541753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.541821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.541995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.542156] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.542249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.542310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.542633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.542633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.542633] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.543416] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-52bd603c-1fc5-4e3b-a554-011984165618 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.543520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.543641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.543796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.543882] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52bd603c-1fc5-4e3b-a554-011984165618',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.045861] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.047593] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.047593] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.047788] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52bd603c-1fc5-4e3b-a554-011984165618 with status ACTIVE [ 1113.047950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.048102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.048102] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.048332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.048421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.048576] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.048664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.048717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.048869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.048940] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.049135] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.049226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.049291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.049517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.049588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.049769] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52bd603c-1fc5-4e3b-a554-011984165618 is going to be updated. [ 1113.072089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.072329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.072329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.072523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.072656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.072817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52bd603c-1fc5-4e3b-a554-011984165618" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.552063] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.036416] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de94ae8c-64b4-4119-bf51-89a5595f402a in Status: SUCCESS [ 1114.036594] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de94ae8c-64b4-4119-bf51-89a5595f402a deletion is rescheduled due to dependency. [ 1114.036709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de94ae8c-64b4-4119-bf51-89a5595f402a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.054694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.055086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.055086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.055234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.055360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.055483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be created. [ 1114.082055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.082055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.082239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.082343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.082505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.093143] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: UNINITIALIZED for 2s [ 1115.914764] env[65455]: INFO networking_nsxv3.common.synchronization [req-b6bcbb4e-f458-46b1-8fb3-bbafa8135e95 req-9517fa2e-f714-4108-a7e5-b3dc3f452696 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1115.915416] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1115.915782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.915911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.915980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.916204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.916356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.916457] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.916522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.917261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.917388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.917493] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.106166] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1116.106996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.107201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.107473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.107786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.107972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.108097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.108349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.108450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.108549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.108648] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.292341] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.292535] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.292651] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.293171] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.293495] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.293668] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.293787] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.294044] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.294192] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.294405] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.294516] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.294684] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.294813] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.294925] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.295042] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.295173] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.319088] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.319088] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.319088] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.319447] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-134" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.319602] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-654e1a7b-2a39-4a7c-9074-27ff53118b1a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.319805] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.319962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.320416] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.320663] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654e1a7b-2a39-4a7c-9074-27ff53118b1a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.419783] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.611660] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.824124] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.824419] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.824560] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.824926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.825761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.825761] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 654e1a7b-2a39-4a7c-9074-27ff53118b1a not found, creating... [ 1116.825761] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.825761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.825969] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.826132] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.826276] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.826573] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.826759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.826874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.827129] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.827278] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.827469] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 654e1a7b-2a39-4a7c-9074-27ff53118b1a is going to be created. [ 1116.850938] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.851219] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.851365] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.851641] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.851933] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.852185] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.922790] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.113939] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edc405b2-4121-462f-8527-3f4dc420de69: rpc.has_security_group_logging(os_id): False [ 1117.139084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.139084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.139084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.139596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.139596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.139596] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be created. [ 1117.204820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.205800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.205800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.205800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.205800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.219702] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1117.425919] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.426071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.426150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.426403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.426500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.426643] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1117.465771] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.465918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.466029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.466289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.466403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.477035] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1117.574919] env[65455]: INFO networking_nsxv3.common.synchronization [req-b6bcbb4e-f458-46b1-8fb3-bbafa8135e95 req-634c0c25-0f00-4de1-bb40-42837858baad service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1117.575353] env[65455]: INFO networking_nsxv3.common.synchronization [req-b6bcbb4e-f458-46b1-8fb3-bbafa8135e95 req-634c0c25-0f00-4de1-bb40-42837858baad service nova] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1117.575465] env[65455]: INFO networking_nsxv3.common.synchronization [req-b6bcbb4e-f458-46b1-8fb3-bbafa8135e95 req-634c0c25-0f00-4de1-bb40-42837858baad service nova] Enqueued Resource ID: 654e1a7b-2a39-4a7c-9074-27ff53118b1a with Priority: HIGHEST for action port [ 1117.576111] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_rules [ 1117.576297] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1117.576448] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654e1a7b-2a39-4a7c-9074-27ff53118b1a with Priority: HIGHEST for action port [ 1117.576874] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.577069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.577170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.577568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.577716] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.579885] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.579885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.579885] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-654e1a7b-2a39-4a7c-9074-27ff53118b1a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.579885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.579885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.580221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.580221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654e1a7b-2a39-4a7c-9074-27ff53118b1a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.625018] env[65455]: INFO networking_nsxv3.common.synchronization [req-8e15a756-8e66-42dd-9f06-d317fbe666e8 req-14793108-e2d4-4519-9327-c2d87bdf1a6b tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1117.625579] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1117.625891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.626025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.626095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.626290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.626540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.626600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.626743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.626917] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.885563] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-bb883f2b-2024-47f5-9125-3c095178500b tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1117.886181] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1117.886510] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.886722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.886807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.887171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.887376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.887500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.887569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.887742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.887826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.887923] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.082217] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.082924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.083828] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 654e1a7b-2a39-4a7c-9074-27ff53118b1a with status ACTIVE [ 1118.084084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.084259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.084367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.084652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.084722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.085158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.085158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.085158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.085330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.085486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.085793] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.085928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.086013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.086308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.086308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.086413] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 654e1a7b-2a39-4a7c-9074-27ff53118b1a is going to be updated. [ 1118.113450] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.113623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.113695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.113905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.114060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.114220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-654e1a7b-2a39-4a7c-9074-27ff53118b1a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.130870] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.131068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.131158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.131400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.131509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.131820] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.131921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.131991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.132189] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.132286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.132394] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1118.162888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.163059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.163150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.163561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.163773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.174768] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1118.284204] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.284571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.284806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.285350] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.285831] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.286129] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.286355] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.286721] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.286948] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.287312] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.287498] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.287680] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.287870] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.288083] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.288261] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.288489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.327032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.327032] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.327032] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.327032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.327032] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-01eb1df9-4884-4d05-b962-d30e51a9e6b6 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.327032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.327032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.327032] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.327032] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01eb1df9-4884-4d05-b962-d30e51a9e6b6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.390767] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.390932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.391092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.391297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.391392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.391627] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.391755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.391842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.392043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.392135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.392239] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 already deleted. [ 1118.392325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.829354] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.829684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.829832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.830155] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.830320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.830497] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 01eb1df9-4884-4d05-b962-d30e51a9e6b6 not found, creating... [ 1118.830800] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.830975] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.831116] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.831369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.831511] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.831943] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.832111] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.832229] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.832670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.832670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.832789] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 01eb1df9-4884-4d05-b962-d30e51a9e6b6 is going to be created. [ 1118.873388] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.873654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.873799] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.874118] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.874362] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.874979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.233972] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1119.233972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.487046] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1119.487285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.487460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.487687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.487878] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.487996] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.488078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.488236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.488318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.488417] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.616015] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-7dc9c402-d54b-419a-b487-f82f6d6b071b service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1119.616290] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-7dc9c402-d54b-419a-b487-f82f6d6b071b service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1119.616512] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-7dc9c402-d54b-419a-b487-f82f6d6b071b service nova] Enqueued Resource ID: 01eb1df9-4884-4d05-b962-d30e51a9e6b6 with Priority: HIGHEST for action port [ 1119.617488] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1119.617712] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1119.617822] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01eb1df9-4884-4d05-b962-d30e51a9e6b6 with Priority: HIGHEST for action port [ 1119.618207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.618370] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.618470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.618821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.619458] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.623595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.623595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.623595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.624040] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.624664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-01eb1df9-4884-4d05-b962-d30e51a9e6b6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.624756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.624756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.625313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.625313] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01eb1df9-4884-4d05-b962-d30e51a9e6b6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.995757] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.127460] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.128921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.129176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.129225] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01eb1df9-4884-4d05-b962-d30e51a9e6b6 with status ACTIVE [ 1120.129482] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.129714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.129714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.129991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.130848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.131072] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.131752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.131752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.131752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.131752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.133018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.133018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.133018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.133018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.133018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.133018] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01eb1df9-4884-4d05-b962-d30e51a9e6b6 is going to be updated. [ 1120.157121] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.157329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.157329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.157663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.157837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.158022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01eb1df9-4884-4d05-b962-d30e51a9e6b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.191458] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1120.191542] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 deletion is rescheduled due to dependency. [ 1120.191656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.346576] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-c8108dcb-fdc4-42a9-b7c0-eb077458cfdf tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1120.347722] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1120.348541] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.348541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.501024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.634532] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.714861] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.715138] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.715223] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.715453] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.715812] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.715976] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.716106] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.716339] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.716482] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.716691] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.716801] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.717088] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.717088] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.717219] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.717219] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.717372] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.737598] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.737598] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.737598] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.737785] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.738120] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-5cbff102-a5d8-4f01-be43-0ddefab008b2 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.738297] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.738419] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.738739] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.738874] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cbff102-a5d8-4f01-be43-0ddefab008b2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.926658] env[65455]: INFO networking_nsxv3.common.synchronization [req-b33b8d1d-836f-440e-b490-507e32f3e96b req-013c0398-7e94-4d28-8716-d0fa4582767b tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1120.927257] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGHEST for action security_group_members [ 1120.927606] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.927753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.927841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.928121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.928737] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.928737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.928737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.929024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.929024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.929088] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.002952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.002952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.002952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.002952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.002952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.002952] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1121.037935] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.038109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.038178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.038388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.038537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.050557] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1121.136952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.137133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.137199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.137461] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.137550] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.137647] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be created. [ 1121.168930] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.169118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.169193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.169456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.169618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.185469] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: UNINITIALIZED for 2s [ 1121.242813] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.243286] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.243430] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.243890] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.244161] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.244424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 5cbff102-a5d8-4f01-be43-0ddefab008b2 not found, creating... [ 1121.244875] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.245300] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.245465] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.245837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.246068] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.246536] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.246775] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.246931] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.247305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.247487] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.247711] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 5cbff102-a5d8-4f01-be43-0ddefab008b2 is going to be created. [ 1121.299626] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.299879] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.300067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.300424] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.300713] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.300989] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.434060] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.434060] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.434060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.434060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b is going to be updated. [ 1121.491769] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.491769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.491769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.491769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.492097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.507768] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: IN_PROGRESS for 2s [ 1121.566786] env[65455]: INFO networking_nsxv3.common.synchronization [req-42906f88-6d74-4013-a189-da0ae05fd787 req-7c6ee47e-8b33-4314-8a85-35be028a6c90 tempest-InstanceActionsTestJSON-1881071793 tempest-InstanceActionsTestJSON-1881071793-project-member] Enqueued Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1121.567563] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 with Priority: HIGHEST for action security_group_members [ 1121.567940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8cab38d-b4ee-4298-97b3-e8115ab313d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.568181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.568258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.568804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.568804] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.568953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.568990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.569516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.569516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.569516] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8cab38d-b4ee-4298-97b3-e8115ab313d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.001495] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-4f0bc5da-0947-4566-b431-550c24031873 service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1122.001495] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-4f0bc5da-0947-4566-b431-550c24031873 service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1122.001495] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-4f0bc5da-0947-4566-b431-550c24031873 service nova] Enqueued Resource ID: 5cbff102-a5d8-4f01-be43-0ddefab008b2 with Priority: HIGHEST for action port [ 1122.004307] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1122.004307] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1122.004307] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cbff102-a5d8-4f01-be43-0ddefab008b2 with Priority: HIGHEST for action port [ 1122.004307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.004307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.004307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.004307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.004307] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cbff102-a5d8-4f01-be43-0ddefab008b2 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.004307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.004307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.004307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.004307] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cbff102-a5d8-4f01-be43-0ddefab008b2',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.073356] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.074045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.074045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.074045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.074045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.074373] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.074373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.074373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.074524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.074524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.075337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 is going to be updated. [ 1122.110038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.110038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.110038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.110038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.110038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.118817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: IN_PROGRESS for 2s [ 1122.508150] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cbff102-a5d8-4f01-be43-0ddefab008b2 with status ACTIVE [ 1122.508620] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.508620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.508620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.508978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.508978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.509178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.509274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.509352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.509502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.509589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.509889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.510067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.510111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.510232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.510324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.510450] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cbff102-a5d8-4f01-be43-0ddefab008b2 is going to be updated. [ 1122.539524] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.539524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.539524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.539524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.539524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.539524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cbff102-a5d8-4f01-be43-0ddefab008b2" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.865430] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-c0470f2a-d0ab-45a2-893a-c080c764e536 tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1122.865883] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1122.866312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.866520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.060838] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1123.061121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.061328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.061607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.062170] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.062319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.062406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.062636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.062741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.062854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.062986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.197143] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1123.197375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.197557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.197788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.198154] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.198268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.198337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.198509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.198594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.198702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.198841] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.200047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.200238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.200415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.200597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.200671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.200830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.200921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.201024] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.235574] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.235772] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.235887] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.236178] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.236941] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.237016] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.237141] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.237442] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.237603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.237806] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.237923] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.238040] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.238148] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.238258] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.238363] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.238489] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.261603] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.261775] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.261909] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.262102] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-642" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.262434] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-2b1b5eab-1ede-463d-b244-4c9364cd02b6 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.262929] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.262929] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.263083] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.263220] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1b5eab-1ede-463d-b244-4c9364cd02b6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.518531] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2391e1ec-f04f-463f-aaa0-77abb954955b in Status: SUCCESS [ 1123.519221] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b deletion is rescheduled due to dependency. [ 1123.519488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.566044] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.566203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.566301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.566489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.566663] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.566758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.566830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.566986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.567091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.567185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.567328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.567444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.567494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.567621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.567788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.567850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.567910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.568489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.568647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.568742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.568838] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.705076] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.705076] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.766062] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.766062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.766062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.766374] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.766523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.766679] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 2b1b5eab-1ede-463d-b244-4c9364cd02b6 not found, creating... [ 1123.766946] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.767122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.767237] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.767469] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.767594] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.767871] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.768058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.768180] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.768384] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.768576] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.768649] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 2b1b5eab-1ede-463d-b244-4c9364cd02b6 is going to be created. [ 1123.788392] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.788636] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.788781] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.789334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.789681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.789956] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.071049] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99: rpc.has_security_group_logging(os_id): False [ 1124.090643] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.090839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.090915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.091549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.091549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.091684] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.091773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.091839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.091994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.092084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.092299] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.092407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.092469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.092616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.092692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.092873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.092962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.093032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.093174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.093244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.093328] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1124.134932] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 in Status: SUCCESS [ 1124.134932] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8cab38d-b4ee-4298-97b3-e8115ab313d7 deletion is rescheduled due to dependency. [ 1124.134932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8cab38d-b4ee-4298-97b3-e8115ab313d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.175478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.175692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.175762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.175985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.176147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.190287] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1124.207213] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.542956] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-70f3ce58-b154-4653-bb1c-2a2366a715b5 service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1124.543511] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-70f3ce58-b154-4653-bb1c-2a2366a715b5 service nova] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1124.543511] env[65455]: INFO networking_nsxv3.common.synchronization [req-0f1742eb-2d4e-431d-a420-5958f4bd7195 req-70f3ce58-b154-4653-bb1c-2a2366a715b5 service nova] Enqueued Resource ID: 2b1b5eab-1ede-463d-b244-4c9364cd02b6 with Priority: HIGHEST for action port [ 1124.547022] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_rules [ 1124.547022] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1124.547022] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b1b5eab-1ede-463d-b244-4c9364cd02b6 with Priority: HIGHEST for action port [ 1124.547022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.547022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.547022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.547022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.547022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b1b5eab-1ede-463d-b244-4c9364cd02b6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.547595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.547595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.547595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.547595] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b1b5eab-1ede-463d-b244-4c9364cd02b6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.709773] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.709955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.710060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.710277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.710368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.710499] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1124.753950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.754135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.754233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.754413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.754562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.767538] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1125.052950] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b1b5eab-1ede-463d-b244-4c9364cd02b6 with status ACTIVE [ 1125.053204] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.053349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.053459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.053695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.053765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.053921] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.053980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.054070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.054204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.054302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.054449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.054542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.054615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.054762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.054835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.054917] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b1b5eab-1ede-463d-b244-4c9364cd02b6 is going to be updated. [ 1125.081755] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.081755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.081755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.081755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.081755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.081755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b1b5eab-1ede-463d-b244-4c9364cd02b6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.205700] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1126.205700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.779388] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1126.779388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.779646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.779938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.780054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.780188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.780338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.780508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.780596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.780708] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.284767] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.532683] env[65455]: INFO networking_nsxv3.common.synchronization [req-3891ca9f-9e40-4627-9b7d-606ecd10977d req-84027a7d-ebd2-486f-9bc4-e0f7a4bd8da9 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1127.533513] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 with Priority: HIGHEST for action security_group_members [ 1127.533884] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c05eda9-c2f4-442b-be6e-f7bc8787f553 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.534017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.534090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.534293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.534445] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.534546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.534609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.534761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.534847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.534968] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c05eda9-c2f4-442b-be6e-f7bc8787f553',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.790079] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.037720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.037980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.038201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.038268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.062156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.062486] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.062621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.062695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.062913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.062998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.063102] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 is going to be updated. [ 1128.093980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.093980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.107627] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: IN_PROGRESS for 2s [ 1128.298054] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.298054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.298054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.298054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.298054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.298054] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1128.338350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.338542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.338606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.338845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.339019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.352084] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1129.108254] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ea057fa4-9630-46cd-8f27-abbcfc290423 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1129.109522] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1129.109876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.110450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.110617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.110982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.111110] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.269518] env[65455]: INFO networking_nsxv3.common.synchronization [None req-70c2795f-498b-4b1e-818b-0b44559e072b tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1129.269518] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1129.269518] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.269518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.538437] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0ac6eedb-4c65-40ce-9750-a37225c9d1cd None None] Enqueued Resource ID: 911f72f4-2c1c-46dc-82a7-5614075e0fe9 with Priority: HIGHEST for action port [ 1129.540216] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 911f72f4-2c1c-46dc-82a7-5614075e0fe9 with Priority: HIGHEST for action port [ 1129.540216] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-911f72f4-2c1c-46dc-82a7-5614075e0fe9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.540216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-911f72f4-2c1c-46dc-82a7-5614075e0fe9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.540216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-911f72f4-2c1c-46dc-82a7-5614075e0fe9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.540216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-911f72f4-2c1c-46dc-82a7-5614075e0fe9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.540216] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('911f72f4-2c1c-46dc-82a7-5614075e0fe9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.635444] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.635444] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 already deleted. [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.635444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.635444] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.045017] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 911f72f4-2c1c-46dc-82a7-5614075e0fe9 [ 1130.045589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.045713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.045713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.045942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.046059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.046875] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:911f72f4-2c1c-46dc-82a7-5614075e0fe9 already deleted. [ 1130.046875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-911f72f4-2c1c-46dc-82a7-5614075e0fe9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.119000] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 in Status: SUCCESS [ 1130.119208] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c05eda9-c2f4-442b-be6e-f7bc8787f553 deletion is rescheduled due to dependency. [ 1130.119335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c05eda9-c2f4-442b-be6e-f7bc8787f553" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.159185] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.159693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.159819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.160655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.160655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.160655] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 already deleted. [ 1130.160655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.369809] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1130.370094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.371156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.371313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.371565] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.371679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.371717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.371883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.371970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.372339] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.875620] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.553105] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.056118] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.056424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.056424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.056914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.056914] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.056914] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1132.073147] env[65455]: INFO networking_nsxv3.common.synchronization [None req-a4513c1c-4950-41c0-bfaf-f39f1a9ee596 None None] Enqueued Resource ID: be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c with Priority: HIGHEST for action port [ 1132.073658] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c with Priority: HIGHEST for action port [ 1132.073977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.074433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.074433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.074631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.074631] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.088230] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.088428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.088546] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.088910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.088968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.100860] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1132.577793] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c [ 1132.578132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.578315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.578479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.578623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.578892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.578892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c already deleted. [ 1132.579190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be74e6b2-ed2f-4cbe-95f5-63ebf8a78f8c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.106962] env[65455]: INFO networking_nsxv3.common.synchronization [req-13bffc43-2c29-4ac4-ac25-3aa2afc87d49 req-e6cc3ad9-c082-4632-89e5-6aee2cee3f87 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1134.108250] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1134.108448] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.108497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.108575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.108907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.109441] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.109705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.109798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.110223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.110223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.110223] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.113544] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1134.113815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.114033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.114567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.114567] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.114768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.114768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.114884] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.114961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.115061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.115223] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.115301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.115547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.115547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.115613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.115708] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.115856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.116013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.116089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.116178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.116512] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.117078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.117247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.117390] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.117490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.117552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.117735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.117816] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.117903] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.580926] env[65455]: INFO networking_nsxv3.common.synchronization [None req-0a47c13b-8b3f-483a-a701-6966faeddaa0 None None] Enqueued Resource ID: 0eeac053-9aa2-451a-bd0a-2eb070039c8a with Priority: HIGHEST for action port [ 1134.582472] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eeac053-9aa2-451a-bd0a-2eb070039c8a with Priority: HIGHEST for action port [ 1134.582472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eeac053-9aa2-451a-bd0a-2eb070039c8a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.582472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eeac053-9aa2-451a-bd0a-2eb070039c8a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.582472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eeac053-9aa2-451a-bd0a-2eb070039c8a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.582703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eeac053-9aa2-451a-bd0a-2eb070039c8a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.582828] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eeac053-9aa2-451a-bd0a-2eb070039c8a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.613382] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.619789] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5be889-3a5a-494d-988c-a8207be8c408: rpc.has_security_group_logging(os_id): False [ 1134.621175] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.642412] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643289] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.643412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.643480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.643665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.643780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.643989] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.644452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.644565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.644751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.644866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.645110] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.645252] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.645369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.645558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.645669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.645784] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be created. [ 1134.709404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.709579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.709579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.709800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.709999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1134.760427] env[65455]: INFO networking_nsxv3.common.synchronization [req-23f10b8e-25c5-4857-8ad0-4e40273bcec3 req-e2ea6aec-61d7-48ed-ac5d-a5bb2b855e73 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 1134.761040] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGHEST for action security_group_members [ 1134.761353] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.761466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.761532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.761722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.761868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.761960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.764807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.766044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.766044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.766044] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.086219] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eeac053-9aa2-451a-bd0a-2eb070039c8a [ 1135.086489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.090025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.090025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.090025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.090025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.090025] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eeac053-9aa2-451a-bd0a-2eb070039c8a already deleted. [ 1135.090025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eeac053-9aa2-451a-bd0a-2eb070039c8a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.116519] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.127453] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.269398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.269398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.269398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.269398] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 is going to be updated. [ 1135.308613] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.308800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.308854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.309038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.309175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.318605] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: IN_PROGRESS for 2s [ 1135.620650] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.620650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.620650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.620857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.620857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.620959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1135.630050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.630804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.630804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.630804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.630804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.630804] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1135.665036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.665036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.665036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.665036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.665036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.667552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.667600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.667812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.667957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.681619] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1135.682420] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1135.741891] env[65455]: INFO networking_nsxv3.common.synchronization [req-86bb6613-724f-4d46-ac52-c427fcdfd808 req-74d1252f-c1e9-47d7-b1ff-48f61c291005 tempest-ServerPasswordTestJSON-1602612332 tempest-ServerPasswordTestJSON-1602612332-project-member] Enqueued Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1135.742465] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1135.742773] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.742897] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.743483] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.743760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.744315] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.744433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.744500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.744689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.744785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.744893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.164978] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-154 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.164978] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-154" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.165380] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-154" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.166832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-154" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.166832] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.166832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.166832] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.167185] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.167416] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.167724] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.168439] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.168652] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.169239] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.169476] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.169741] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.170158] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.249589] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.249905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.249905] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.250064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.250125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.250335] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.250441] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.250499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.250660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.250738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.250827] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e66828-af2a-4298-8b2d-caf16521cf90 already deleted. [ 1136.250911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.404261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.404261] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.234 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.404261] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.404545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-154" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.404744] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-057910b6-705b-4057-af62-088d92733ecb taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.404897] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.404948] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.405297] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.405421] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('057910b6-705b-4057-af62-088d92733ecb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.748677] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1136.748677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.748849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.748979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.749101] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.914130] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.914130] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 057910b6-705b-4057-af62-088d92733ecb not found, creating... [ 1136.914130] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.914130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.914650] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.914650] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.914796] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.914825] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.915079] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.915253] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.915367] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 057910b6-705b-4057-af62-088d92733ecb is going to be created. [ 1136.940445] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.940773] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.940853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.941282] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.941556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.941785] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.252275] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.252653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.309590] env[65455]: INFO networking_nsxv3.common.synchronization [None req-af7845a6-4d41-4d5e-bbf5-ec12e73c28b5 None None] Enqueued Resource ID: 75b34ec6-f245-4c48-b51b-a40e18803acd with Priority: HIGHEST for action port [ 1137.310554] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75b34ec6-f245-4c48-b51b-a40e18803acd with Priority: HIGHEST for action port [ 1137.310972] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-75b34ec6-f245-4c48-b51b-a40e18803acd taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.311170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75b34ec6-f245-4c48-b51b-a40e18803acd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.311261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75b34ec6-f245-4c48-b51b-a40e18803acd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.311695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75b34ec6-f245-4c48-b51b-a40e18803acd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.311787] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75b34ec6-f245-4c48-b51b-a40e18803acd',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.330559] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 in Status: SUCCESS [ 1137.330763] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 deletion is rescheduled due to dependency. [ 1137.330886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.454439] env[65455]: INFO networking_nsxv3.common.synchronization [req-86bb6613-724f-4d46-ac52-c427fcdfd808 req-0596c09a-4a3f-442e-83b4-50a06a8560db service nova] Enqueued Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_rules [ 1137.454439] env[65455]: INFO networking_nsxv3.common.synchronization [req-86bb6613-724f-4d46-ac52-c427fcdfd808 req-0596c09a-4a3f-442e-83b4-50a06a8560db service nova] Enqueued Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1137.454439] env[65455]: INFO networking_nsxv3.common.synchronization [req-86bb6613-724f-4d46-ac52-c427fcdfd808 req-0596c09a-4a3f-442e-83b4-50a06a8560db service nova] Enqueued Resource ID: 057910b6-705b-4057-af62-088d92733ecb with Priority: HIGHEST for action port [ 1137.454439] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_rules [ 1137.458477] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1137.460267] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 057910b6-705b-4057-af62-088d92733ecb with Priority: HIGHEST for action port [ 1137.461209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.461323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.461531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.461640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.461724] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.462667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.462791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.462848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.463029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.463196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.463306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.463396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.463627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.463759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.463918] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.464896] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-057910b6-705b-4057-af62-088d92733ecb taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.465057] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.465125] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.465427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.465475] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('057910b6-705b-4057-af62-088d92733ecb',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.698337] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1137.698624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.699490] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1137.699749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.699943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.700224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.700456] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.700808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.700808] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.700908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.700986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.701092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.701204] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.814573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75b34ec6-f245-4c48-b51b-a40e18803acd [ 1137.815248] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.815456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.815557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.815814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.815979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.816260] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75b34ec6-f245-4c48-b51b-a40e18803acd already deleted. [ 1137.816419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75b34ec6-f245-4c48-b51b-a40e18803acd" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.902651] env[65455]: INFO networking_nsxv3.common.synchronization [req-50e5f34c-e162-47f2-b05a-63895e3d0a3c req-3365b651-90b7-46c9-9a75-889bf0c58424 tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1137.903681] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1137.904127] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.904283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.904353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.904624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.904808] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.904910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.904970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.905185] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.905297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.905395] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.967496] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.969452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.969674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.969960] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 057910b6-705b-4057-af62-088d92733ecb with status ACTIVE [ 1137.970859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.971157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.971396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.971640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.971734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.971950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.972061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.972127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.972319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.972397] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.972587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.972738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.972794] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.972901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.972978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.973067] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 057910b6-705b-4057-af62-088d92733ecb is going to be updated. [ 1137.996691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.996937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.996937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.997119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.997273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.997431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-057910b6-705b-4057-af62-088d92733ecb" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.205344] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.205516] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.371732] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6f3ab4f-8636-439e-a6c9-901faf8fda10 req-6a8cee00-17c3-4118-bd2b-5bfea3b2d306 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1138.372618] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1138.373104] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.373289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.373407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.373785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.374040] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.374209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.374304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.374632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.374678] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.374831] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.406986] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.476028] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.763438] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.763641] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.763767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.765693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.765693] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.765693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.765693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.765693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.765693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.765693] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.765693] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.766123] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.766123] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.766123] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.766123] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.766220] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.785723] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.785901] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.786055] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.786240] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.786561] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-6db27681-9482-410a-af38-b94a710703cc taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.786737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.786853] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.787215] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.787353] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db27681-9482-410a-af38-b94a710703cc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.877257] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.877487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.877487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.877714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.877873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.878148] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.878203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.878319] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.878413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.878493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.878580] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 already deleted. [ 1138.878661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.911138] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.979784] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.979962] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.980015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.980282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.980378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.980479] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e66828-af2a-4298-8b2d-caf16521cf90 is going to be created. [ 1139.009176] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.009467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.009467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.009867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.010158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.023336] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: UNINITIALIZED for 2s [ 1139.292031] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.292031] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.292031] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.292031] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.292031] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.292371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 6db27681-9482-410a-af38-b94a710703cc not found, creating... [ 1139.292464] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.292627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.292744] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.292981] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.293140] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.293430] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.293762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.293762] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.293934] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.294080] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.294224] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 6db27681-9482-410a-af38-b94a710703cc is going to be created. [ 1139.337034] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.337034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.337034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.337335] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.337686] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.338043] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.414628] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.415143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.415143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.415143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.415333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.415333] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1139.475975] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.476166] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.476231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.476445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.476612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.492727] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1140.068340] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6f3ab4f-8636-439e-a6c9-901faf8fda10 req-d31b17bb-1baa-4286-bc74-0e30027f2585 service nova] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1140.068340] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6f3ab4f-8636-439e-a6c9-901faf8fda10 req-d31b17bb-1baa-4286-bc74-0e30027f2585 service nova] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1140.068340] env[65455]: INFO networking_nsxv3.common.synchronization [req-d6f3ab4f-8636-439e-a6c9-901faf8fda10 req-d31b17bb-1baa-4286-bc74-0e30027f2585 service nova] Enqueued Resource ID: 6db27681-9482-410a-af38-b94a710703cc with Priority: HIGHEST for action port [ 1140.068701] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_rules [ 1140.069056] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1140.071782] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6db27681-9482-410a-af38-b94a710703cc with Priority: HIGHEST for action port [ 1140.071782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.071782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.071782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.071782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.071782] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.071782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.071782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.071782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.072879] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.073130] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.074181] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.074306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.074534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.075278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.075278] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.079224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-6db27681-9482-410a-af38-b94a710703cc taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.079662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.079662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.079746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.079861] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6db27681-9482-410a-af38-b94a710703cc',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.583520] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.583844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.583878] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.584890] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6db27681-9482-410a-af38-b94a710703cc with status ACTIVE [ 1140.585448] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.585448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.585448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.585628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.585628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.585754] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.585812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.585876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.586050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.586132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.586320] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.586412] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.586473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.586655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.586733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.586822] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6db27681-9482-410a-af38-b94a710703cc is going to be updated. [ 1140.616759] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.616759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.616759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.616759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.616759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.616759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6db27681-9482-410a-af38-b94a710703cc" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.037064] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: SUCCESS [ 1141.037341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.037695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.037986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.038228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.038377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.038480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.038711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.038817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.038975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.039237] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.090144] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.504888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1141.505207] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.505405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.505675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.505914] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.506078] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.506178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.506383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.506477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.506598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.506786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.506917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.507014] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.507226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.507406] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.507540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.507664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.507796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.507890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.507994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.508175] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.542064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.542064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.542064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.542398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.542398] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.542655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.542655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.543042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.543042] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.543192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.543366] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.543464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.543464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.543721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.543849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.543972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.544130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.544266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.544418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.544490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.544589] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.593263] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.593764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.593764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.594168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.594353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.594529] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 is going to be created. [ 1141.652273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.652493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.652493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.652716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.652858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.664506] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: UNINITIALIZED for 2s [ 1142.011037] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5be889-3a5a-494d-988c-a8207be8c408: rpc.has_security_group_logging(os_id): False [ 1142.035957] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.036223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.036223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.036423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.036613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.036912] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.037027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.037145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.037357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.037657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.038359] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.038359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.038359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.038565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.038594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.039232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.039232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.039232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.039365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.039631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.039688] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1142.046809] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 77e66828-af2a-4298-8b2d-caf16521cf90: rpc.has_security_group_logging(os_id): False [ 1142.064688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.064899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.065614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.065766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.065863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.066114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.066227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.066311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.066477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.066572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.066765] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.066865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.066926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.067140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.067208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.067345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.067443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.067489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.067653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.067711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.067772] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 77e66828-af2a-4298-8b2d-caf16521cf90 is going to be created. [ 1142.130528] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.130785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.130953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.132187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.132187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.148553] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1142.162875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.162875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.163137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.163236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.163430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.181340] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: IN_PROGRESS for 2s [ 1142.489309] env[65455]: INFO networking_nsxv3.common.synchronization [req-8d180b5c-4ae5-4179-a908-d6509082e912 req-dcac1a19-d7e3-4206-82e5-08e1054aab29 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 1142.490590] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGHEST for action security_group_members [ 1142.491259] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.491493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.491620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.491912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.492089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.494554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.494554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.494926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.494926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.495698] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.997255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.000070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.000070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.000070] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a is going to be updated. [ 1143.029184] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.029403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.029478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.029813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.029963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.041046] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: IN_PROGRESS for 2s [ 1143.247030] env[65455]: INFO networking_nsxv3.common.synchronization [req-502c36ae-e5df-4122-bf36-f9ad33bbbed9 req-b0b540bf-4fdc-47bb-bab8-8a563024b565 tempest-ServersTestJSON-2083827205 tempest-ServersTestJSON-2083827205-project-member] Enqueued Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1143.251270] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 with Priority: HIGHEST for action security_group_members [ 1143.251270] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.251270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.251270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.251270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.251270] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.251632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.251632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.251632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.251632] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.252116] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e9d5580-b38c-4840-86f0-a6cc8d6dbd99',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.675185] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: SUCCESS [ 1143.675401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.675567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.675801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.675995] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.676121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.676187] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.676348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.676442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.676528] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.676618] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.756451] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.756612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.756694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.756913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.757248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.757519] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.757709] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.757792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.758013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.758141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.758401] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 is going to be updated. [ 1143.786866] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.787060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.787060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.787385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.787596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.799370] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: IN_PROGRESS for 2s [ 1144.164417] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1144.164755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.165036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.165278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.165385] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.180021] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.196510] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: SUCCESS [ 1144.196758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.667553] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.667835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.667835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.667967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.668174] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.668293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.668351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.668471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.668548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.668635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.668726] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.681351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9b2cce2-94bc-4c70-8464-19808dc5cfe1: rpc.has_security_group_logging(os_id): False [ 1144.699873] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.700018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.700086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.700304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.700392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.700645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.700755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.700823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.700986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.701468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.701468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 is going to be created. [ 1144.770611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.770611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.770611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.770611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.770611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.783632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: IN_PROGRESS for 2s [ 1145.052189] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a in Status: SUCCESS [ 1145.052393] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a deletion is rescheduled due to dependency. [ 1145.052573] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.171284] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.171656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.171656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.171656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.171887] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.171976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.172073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.172364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.172459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.172569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.172797] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.172981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.173112] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.173401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.173563] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.173758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.173838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.174059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.174240] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.174427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.174566] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.677657] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5be889-3a5a-494d-988c-a8207be8c408: rpc.has_security_group_logging(os_id): False [ 1145.699269] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.699717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.699717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.699993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.700162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.700479] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.700741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.700741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.701013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.701148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.701513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.701639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.701676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.701820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.701893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.702208] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.702364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.702411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.702565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.702663] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.702727] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1145.859233] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 in Status: SUCCESS [ 1145.859233] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e9d5580-b38c-4840-86f0-a6cc8d6dbd99 deletion is rescheduled due to dependency. [ 1145.859233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e9d5580-b38c-4840-86f0-a6cc8d6dbd99" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.907867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.908333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.908378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.908620] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.908803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.931774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1146.797799] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: SUCCESS [ 1146.798121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.829152] env[65455]: INFO networking_nsxv3.common.synchronization [req-7efbe2fa-c395-4523-927f-e0b38748a825 req-1353f964-5437-4dee-a0d9-bb3bb36cd657 tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 1146.829747] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f01b182-5b01-4e49-8f70-13d804029019 with Priority: HIGHEST for action security_group_members [ 1146.830075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f01b182-5b01-4e49-8f70-13d804029019 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.830199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.830263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.830466] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.830629] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.830743] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.830807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.831422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.831422] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.831422] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f01b182-5b01-4e49-8f70-13d804029019',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.333729] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.333729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.333729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.333729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.333909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.334486] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.335094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.335094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.335183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.335290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.335392] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 is going to be updated. [ 1147.378091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.378091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.378091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.378091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.378091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.387035] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: IN_PROGRESS for 2s [ 1147.488893] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef9958df-4f55-4bf3-b81d-d24867577e4b req-7c59f282-c679-44be-9254-a9fa387ac70d tempest-ServersNegativeTestJSON-692253222 tempest-ServersNegativeTestJSON-692253222-project-member] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1147.488893] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1147.488893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.488893] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.489091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.489246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.489468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.489583] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.489655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.490798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.491076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.491076] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.890060] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.890443] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.890443] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.890719] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.890988] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.891162] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.891330] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.891560] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.891699] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.891899] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.892044] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.892152] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.892223] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.892328] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.892426] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.892584] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.912359] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.912359] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.912510] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.913139] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.913139] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-c17c5377-b3f2-43d2-98f6-f06b83ad0234 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.913139] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.913312] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.913556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.913726] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17c5377-b3f2-43d2-98f6-f06b83ad0234',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.948205] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1147.948440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.998316] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.998488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.998533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.998735] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.998844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.999023] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.999123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.999177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.999324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.999400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.999484] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 already deleted. [ 1147.999563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.281817] env[65455]: INFO networking_nsxv3.common.synchronization [req-a589725b-8e7c-44c3-8e60-12bd0b0c89b5 req-6d05905c-d539-44d4-82ce-0cff9193ebc7 tempest-ServerPasswordTestJSON-1602612332 tempest-ServerPasswordTestJSON-1602612332-project-member] Enqueued Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1148.282401] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77e66828-af2a-4298-8b2d-caf16521cf90 with Priority: HIGHEST for action security_group_members [ 1148.282720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-77e66828-af2a-4298-8b2d-caf16521cf90 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.282848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.282924] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.283279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.283447] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283554] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.283781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.283867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.283960] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('77e66828-af2a-4298-8b2d-caf16521cf90',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.415750] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.416071] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.416252] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.416592] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.416771] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.416992] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port c17c5377-b3f2-43d2-98f6-f06b83ad0234 not found, creating... [ 1148.417394] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.417573] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.417711] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.417971] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.418123] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.418479] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.418671] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.418748] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.419193] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.419273] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.419488] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 is going to be created. [ 1148.465320] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.465320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.465320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.465320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.465320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.465692] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.786534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.786730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.786854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.787144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.787287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.787681] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.787922] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.787985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.788206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.788339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.788483] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e66828-af2a-4298-8b2d-caf16521cf90 is going to be updated. [ 1148.830880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.831059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.831195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.831366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.831511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.843332] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: IN_PROGRESS for 2s [ 1149.191927] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef9958df-4f55-4bf3-b81d-d24867577e4b req-3d1d53e9-4899-445f-b347-3ff6b0dd24d8 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1149.192204] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef9958df-4f55-4bf3-b81d-d24867577e4b req-3d1d53e9-4899-445f-b347-3ff6b0dd24d8 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1149.192259] env[65455]: INFO networking_nsxv3.common.synchronization [req-ef9958df-4f55-4bf3-b81d-d24867577e4b req-3d1d53e9-4899-445f-b347-3ff6b0dd24d8 service nova] Enqueued Resource ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 with Priority: HIGHEST for action port [ 1149.192796] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1149.192941] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1149.193056] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 with Priority: HIGHEST for action port [ 1149.193340] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.193460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.193525] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.193785] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.193901] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.194897] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.195048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.195132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.195320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.195472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.195566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.195628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.195766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.195851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.195941] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.196703] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17c5377-b3f2-43d2-98f6-f06b83ad0234 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.196810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.196876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.197063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.197112] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17c5377-b3f2-43d2-98f6-f06b83ad0234',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.397194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f01b182-5b01-4e49-8f70-13d804029019 in Status: SUCCESS [ 1149.397418] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f01b182-5b01-4e49-8f70-13d804029019 deletion is rescheduled due to dependency. [ 1149.397582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f01b182-5b01-4e49-8f70-13d804029019" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.698693] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.698828] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.699258] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.700014] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c17c5377-b3f2-43d2-98f6-f06b83ad0234 with status ACTIVE [ 1149.700622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.700622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.700622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.700622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.700863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.700893] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.700983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.701065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.701243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.701307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.702200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.702200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.702200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.702200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.702200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.702200] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 is going to be updated. [ 1149.726789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.726789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.726789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.726789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.726789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.726789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.204903] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.252353] env[65455]: INFO networking_nsxv3.common.synchronization [req-4984192f-d446-410b-bbf3-1c64abb46904 req-0dab5928-78f7-4ad5-a914-656fb434e310 tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 1150.252891] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 1150.253364] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.253364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.253504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.253768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.253938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.254054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.254118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.254281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.254466] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.707153] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.707335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.707378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.707596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.707685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.707786] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be created. [ 1150.734016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.734228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.734228] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.734454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.734611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.744638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: UNINITIALIZED for 2s [ 1150.757396] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.854849] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 77e66828-af2a-4298-8b2d-caf16521cf90 in Status: SUCCESS [ 1150.854849] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 77e66828-af2a-4298-8b2d-caf16521cf90 deletion is rescheduled due to dependency. [ 1150.854849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-77e66828-af2a-4298-8b2d-caf16521cf90" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.260060] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.763258] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.763258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.763258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.763258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.763258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.763258] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 1151.797866] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.797866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.797866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.797866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.797866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.809476] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 1152.321279] env[65455]: INFO networking_nsxv3.common.synchronization [None req-f49660bc-3fd1-43ae-acab-593b0c25052e tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1152.324191] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1152.326977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.326977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.326977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.328070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.328070] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.464908] env[65455]: INFO networking_nsxv3.common.synchronization [None req-ea08678d-6e3a-4993-84e7-6ae3d5b695ce tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1152.464908] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1152.464908] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.464908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.757959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1152.757959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.757959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.758234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.758362] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.758492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.758560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.758742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.758823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.758904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.758994] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.853239] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.853398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.853446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.853657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.853749] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.853833] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 already deleted. [ 1152.853912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.854080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.854255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.854313] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.204547] env[65455]: INFO networking_nsxv3.common.synchronization [req-11f8823a-1341-4c4e-8162-ca9ca0d910b1 req-a6027863-57f6-40fc-a0bf-172f93da522c tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1153.206024] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1153.206393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.206535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.206589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.206780] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.206929] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207436] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.261725] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.261971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.262163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.262498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.262733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.262944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.263139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.263645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.263645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.263804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.264597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.264597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.264597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.264597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.264731] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.264825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.264868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.265077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.265164] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.265298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.265396] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.376723] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.376994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.376994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.377568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.377568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.377568] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 already deleted. [ 1153.377568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.537979] env[65455]: INFO networking_nsxv3.common.synchronization [req-3e9cc580-eaad-424b-bdc7-5c5705eb5d7f req-cfddd337-76c2-46bc-9aa7-a10f9081ddfc tempest-ListServersNegativeTestJSON-2092824379 tempest-ListServersNegativeTestJSON-2092824379-project-member] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1153.541159] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGHEST for action security_group_members [ 1153.541159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.541159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.710420] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.717374] env[65455]: INFO networking_nsxv3.common.synchronization [None req-cbfe0564-c5e3-4045-ab13-46ad7bdc9ad1 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1153.718076] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1153.718468] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.718559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.718631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.718910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.718996] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.768134] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd1120c8-14cf-47d8-87d2-dfaa63f749d7: rpc.has_security_group_logging(os_id): False [ 1153.787849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788051] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.788600] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.788694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.788773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.788913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.788995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.789375] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.789936] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.790052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.790355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.791587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.791587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.791587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.791587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.791824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.792495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.792625] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be created. [ 1153.821585] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 1153.821585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.843403] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5920f320-a792-406a-a5fd-57a1bf5443e9 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1153.844060] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1153.846177] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.846177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.880145] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.880362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.880456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.880751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.880994] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.900842] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1154.214520] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.247202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.247347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.247405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.248549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.248549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.248549] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe already deleted. [ 1154.248549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.248549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.248549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.248549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.717680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.717680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.717680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.718283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.718283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.718283] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1154.750775] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.752141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.752141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.752141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.752141] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.768361] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1154.775733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.775886] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.775956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.776202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.776288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.776390] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe already deleted. [ 1154.776474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.917984] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1155.918309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.792425] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1156.792665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.792832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.793115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.793326] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.793508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.793508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.793680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.793783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.793996] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.296321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.296715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.296715] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.296900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.297074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.297338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.297517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.297606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.297873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.298040] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.298194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be updated. [ 1157.332375] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.332567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.332643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.333050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.333050] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.347015] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: IN_PROGRESS for 2s [ 1157.966949] env[65455]: INFO networking_nsxv3.common.synchronization [req-71bc40b9-8af3-4d7f-94d7-881221876229 req-0beae423-0cf3-4141-8076-261394267cae tempest-ServerRescueNegativeTestJSON-1455608166 tempest-ServerRescueNegativeTestJSON-1455608166-project-member] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 1157.967615] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGHEST for action security_group_members [ 1157.968215] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.968382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.968489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.968750] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.968920] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.969108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.969199] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.969367] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.969478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.969617] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.472886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.473320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.473320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.473650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.473786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.474066] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.474212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.474322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.474498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.474596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.474730] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be updated. [ 1158.509717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.510028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.510028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.510167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.510303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.531192] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: IN_PROGRESS for 2s [ 1159.359456] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5be889-3a5a-494d-988c-a8207be8c408 in Status: SUCCESS [ 1159.359791] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 deletion is rescheduled due to dependency. [ 1159.360024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.372665] env[65455]: INFO networking_nsxv3.common.synchronization [req-721d42fe-751e-419c-9326-3785aa985b10 req-828e0c9c-f2b8-4017-a745-28f81577f957 tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1159.373681] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1159.374158] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.374337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.374444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.374741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.374977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.375157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.375259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.375526] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.375673] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.375826] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.878841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.879333] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.879462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.879817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.879927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.880253] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.880417] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.880514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.880787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.880906] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.881065] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1159.913644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.913644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.913918] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.914294] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.914592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.927295] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1160.543537] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9354847f-0991-42fd-9b0e-3a2865fde47c in Status: SUCCESS [ 1160.543537] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c deletion is rescheduled due to dependency. [ 1160.543537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.576645] env[65455]: INFO networking_nsxv3.common.synchronization [req-3e4902ed-2f38-4fa5-9f87-1dec6099192f req-9fb6c5be-06a7-467b-8770-07301183cd57 tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1161.577382] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1161.577839] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.578644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.578644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.580214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.580405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.580529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.580595] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.580830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.581128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.581128] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.938957] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1161.938957] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef deletion is rescheduled due to dependency. [ 1161.938957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.999119] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.999370] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.999783] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.999837] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.000121] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.000281] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.000396] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.000612] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.000757] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.000998] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.001128] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.001250] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.001380] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.001464] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.001569] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.001696] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.021103] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.021281] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.021420] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.021595] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.021894] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-a73afdc1-3123-4891-9d25-17c7c9a7303f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.022074] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.022193] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.022518] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.022655] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73afdc1-3123-4891-9d25-17c7c9a7303f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.083402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.083565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.083637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.083847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.083939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.084149] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.084245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.084338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.084448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.084560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.084617] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 already deleted. [ 1162.084721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.525224] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.525671] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.525671] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.525847] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.526034] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.526149] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port a73afdc1-3123-4891-9d25-17c7c9a7303f not found, creating... [ 1162.526404] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.526571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.526670] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.526889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.527036] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.527317] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.527468] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.527580] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.527797] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.528174] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.528288] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: a73afdc1-3123-4891-9d25-17c7c9a7303f is going to be created. [ 1162.549020] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.549385] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.549479] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.549824] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.550097] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.550357] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.258693] env[65455]: INFO networking_nsxv3.common.synchronization [req-3e4902ed-2f38-4fa5-9f87-1dec6099192f req-38dc3f30-b87d-456f-af78-a8a800e3fe23 service nova] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1163.258952] env[65455]: INFO networking_nsxv3.common.synchronization [req-3e4902ed-2f38-4fa5-9f87-1dec6099192f req-38dc3f30-b87d-456f-af78-a8a800e3fe23 service nova] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1163.258952] env[65455]: INFO networking_nsxv3.common.synchronization [req-3e4902ed-2f38-4fa5-9f87-1dec6099192f req-38dc3f30-b87d-456f-af78-a8a800e3fe23 service nova] Enqueued Resource ID: a73afdc1-3123-4891-9d25-17c7c9a7303f with Priority: HIGHEST for action port [ 1163.259492] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1163.259630] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1163.259726] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73afdc1-3123-4891-9d25-17c7c9a7303f with Priority: HIGHEST for action port [ 1163.260330] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.260491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.260562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.260779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.260886] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.262197] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.262320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.262372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.262740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.262825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.262926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.262991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.263159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.263278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.263324] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.264623] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a73afdc1-3123-4891-9d25-17c7c9a7303f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.264623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.264623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.264623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.264623] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73afdc1-3123-4891-9d25-17c7c9a7303f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.765997] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.766203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.766430] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.767256] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a73afdc1-3123-4891-9d25-17c7c9a7303f with status ACTIVE [ 1163.767920] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.767920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.767920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.767920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.768142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.769009] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.769009] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.769009] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.769341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.769341] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.769397] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a73afdc1-3123-4891-9d25-17c7c9a7303f is going to be updated. [ 1163.792061] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.792231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.792284] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.792492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.792676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.792838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.828131] env[65455]: INFO networking_nsxv3.common.synchronization [req-3c67e5b0-606b-4331-9dc5-6f0673efb2ee req-20df445d-42af-403b-90a0-bc6997480f04 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1163.829142] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1163.829303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.829710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.829710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.830287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.830287] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.830287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.830287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.830439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.830510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.830587] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.137299] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.137447] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.137569] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.137892] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.138171] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.138328] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.138443] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.138669] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.138817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.139042] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.139160] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.139275] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.140044] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.140044] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.140044] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.140044] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.160039] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.160039] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.160039] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.160359] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.160594] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-24f0e7f9-378c-4862-8b88-cea8d0725093 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.160819] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.160961] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.161322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.161468] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f0e7f9-378c-4862-8b88-cea8d0725093',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.272239] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.333171] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.333447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.333570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.333896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.334066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.334388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.334562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.334677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.334938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.335095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.335243] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe already deleted. [ 1164.335386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.663533] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.663751] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.664164] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.664229] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.664359] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.664510] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 24f0e7f9-378c-4862-8b88-cea8d0725093 not found, creating... [ 1164.664766] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.664922] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.665050] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.665278] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.665413] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.665696] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.665851] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.665967] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.666192] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.666322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.666458] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 24f0e7f9-378c-4862-8b88-cea8d0725093 is going to be created. [ 1164.686570] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.687051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.687051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.687342] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.687577] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.687923] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.775073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.775295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.775295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.775521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.775612] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.775717] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 is going to be created. [ 1164.809842] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.810059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.810128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.810343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.810498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.821546] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: UNINITIALIZED for 2s [ 1165.389502] env[65455]: INFO networking_nsxv3.common.synchronization [req-3c67e5b0-606b-4331-9dc5-6f0673efb2ee req-67d4ff66-b663-4a39-84e9-d02845054a08 service nova] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1165.389775] env[65455]: INFO networking_nsxv3.common.synchronization [req-3c67e5b0-606b-4331-9dc5-6f0673efb2ee req-67d4ff66-b663-4a39-84e9-d02845054a08 service nova] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1165.389775] env[65455]: INFO networking_nsxv3.common.synchronization [req-3c67e5b0-606b-4331-9dc5-6f0673efb2ee req-67d4ff66-b663-4a39-84e9-d02845054a08 service nova] Enqueued Resource ID: 24f0e7f9-378c-4862-8b88-cea8d0725093 with Priority: HIGHEST for action port [ 1165.390417] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_rules [ 1165.390636] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1165.390812] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24f0e7f9-378c-4862-8b88-cea8d0725093 with Priority: HIGHEST for action port [ 1165.391212] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.391344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.391411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.391617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.391698] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.392798] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.392926] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.392989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.393265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.393545] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.393545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.393703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.393866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.393866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.393996] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.395145] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-24f0e7f9-378c-4862-8b88-cea8d0725093 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.395295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.395352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.395758] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.395758] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f0e7f9-378c-4862-8b88-cea8d0725093',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.896924] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.897984] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.898126] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.898434] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24f0e7f9-378c-4862-8b88-cea8d0725093 with status ACTIVE [ 1165.898602] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.898732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.898778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.899834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.899834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.900222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.900222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.900222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.900222] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24f0e7f9-378c-4862-8b88-cea8d0725093 is going to be updated. [ 1165.921685] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.921837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.921912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.922153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.922317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.922518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24f0e7f9-378c-4862-8b88-cea8d0725093" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.071433] env[65455]: INFO networking_nsxv3.common.synchronization [req-75244c9d-2439-40d9-9e3c-e17a00a1e419 req-f97725bf-e97d-4850-a522-98b189c027f0 tempest-ServersNegativeTestJSON-692253222 tempest-ServersNegativeTestJSON-692253222-project-member] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1166.072485] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1166.072821] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.072950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.073031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.073227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.073370] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.073471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.073601] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.073675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.073760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.073852] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.381396] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.381626] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.381752] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.382070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.382660] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.382825] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.382947] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.383186] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.383334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.383542] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.383657] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1166.383765] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1166.383920] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1166.383989] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1166.384098] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1166.384272] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1166.398905] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.404062] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1166.404243] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1166.404381] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1166.404556] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.404862] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-33ba32b9-24f5-4ce9-baf5-dc9514b87138 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.405052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.405173] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.405498] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.405637] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33ba32b9-24f5-4ce9-baf5-dc9514b87138',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.576140] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.835566] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: SUCCESS [ 1166.835792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.835985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.836250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.836582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.836729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.836799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.836990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.837094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.837186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.837279] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.901163] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.901381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.901440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.901694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.901766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.901873] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe is going to be created. [ 1166.908466] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.908684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.908817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.909578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.909764] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.910438] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 33ba32b9-24f5-4ce9-baf5-dc9514b87138 not found, creating... [ 1166.910438] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.910438] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.910648] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.910768] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.910905] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.911239] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.911392] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.911663] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.911748] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.911850] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.912012] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 33ba32b9-24f5-4ce9-baf5-dc9514b87138 is going to be created. [ 1166.931707] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.932213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.932213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.932290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.932570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.936066] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.936066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.936066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.936066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.936363] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.936457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.947420] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: UNINITIALIZED for 2s [ 1167.080047] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.108291] env[65455]: INFO networking_nsxv3.common.synchronization [req-dbef8d90-09ef-43f1-bd87-46b50fd48f1f req-b7d1aa38-c3d3-4a24-975a-27e2ceaa360f tempest-AttachVolumeTestJSON-1505693899 tempest-AttachVolumeTestJSON-1505693899-project-member] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1167.109565] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGHEST for action security_group_members [ 1167.110108] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.110285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.110384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.110658] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.111070] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.111208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.111298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.111534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.111653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.111781] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.340059] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.583272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.583720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.583720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.583720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.583720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.583894] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1167.615445] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.615445] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.615445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.615856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.615856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.615856] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 is going to be updated. [ 1167.619735] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.619972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.619972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.620275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.620519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.631094] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1167.652089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.652089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.652089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.652440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.652440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.662280] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: IN_PROGRESS for 2s [ 1167.697982] env[65455]: INFO networking_nsxv3.common.synchronization [req-75244c9d-2439-40d9-9e3c-e17a00a1e419 req-1e0d5d54-7ce3-4ad8-855c-104849ef6917 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1167.698221] env[65455]: INFO networking_nsxv3.common.synchronization [req-75244c9d-2439-40d9-9e3c-e17a00a1e419 req-1e0d5d54-7ce3-4ad8-855c-104849ef6917 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1167.698360] env[65455]: INFO networking_nsxv3.common.synchronization [req-75244c9d-2439-40d9-9e3c-e17a00a1e419 req-1e0d5d54-7ce3-4ad8-855c-104849ef6917 service nova] Enqueued Resource ID: 33ba32b9-24f5-4ce9-baf5-dc9514b87138 with Priority: HIGHEST for action port [ 1167.698906] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1167.699089] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1167.699189] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33ba32b9-24f5-4ce9-baf5-dc9514b87138 with Priority: HIGHEST for action port [ 1167.699440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.699562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.699628] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.699862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.699981] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.703377] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.703377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.703377] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-33ba32b9-24f5-4ce9-baf5-dc9514b87138 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.703377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.703377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.703377] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.703377] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33ba32b9-24f5-4ce9-baf5-dc9514b87138',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.843726] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92fa1390-194c-4487-a7c0-cfbabb347759: rpc.has_security_group_logging(os_id): False [ 1167.863119] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.863119] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.863119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.863119] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 is going to be created. [ 1167.934742] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.934742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.934742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.934742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.934742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.946194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: IN_PROGRESS for 2s [ 1168.204881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.205086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.205318] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33ba32b9-24f5-4ce9-baf5-dc9514b87138 with status ACTIVE [ 1168.205492] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.205603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.205704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.205878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.205970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.206173] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.206264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.206304] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.206464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.206582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.206849] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.206935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.207082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.207163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.207237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.207325] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33ba32b9-24f5-4ce9-baf5-dc9514b87138 is going to be updated. [ 1168.238430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.238430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.238430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.238430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.238430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.238430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33ba32b9-24f5-4ce9-baf5-dc9514b87138" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.957629] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: SUCCESS [ 1168.957955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.958110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958357] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.958556] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.958674] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.958738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.958898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.958977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.959087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.959179] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.462536] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.645246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1169.645494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.645719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.645952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.646250] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.646405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.647170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.647386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.647482] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.647577] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.671246] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 in Status: SUCCESS [ 1169.671724] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 deletion is rescheduled due to dependency. [ 1169.671848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.966099] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: SUCCESS [ 1169.966374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.967672] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d8a958a-bd0c-4a44-825e-4612e0696bbe: rpc.has_security_group_logging(os_id): False [ 1169.986389] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.986666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.986791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.987059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.987444] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.987891] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.988029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.988216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.988324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.988324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.988409] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe is going to be created. [ 1170.054888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.055055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.055150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.055467] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.055681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.066843] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: IN_PROGRESS for 2s [ 1170.151938] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.658013] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.829600] env[65455]: INFO networking_nsxv3.common.synchronization [None req-42a23a93-7844-40b5-b527-963731ade451 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1170.830335] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1170.830717] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.830849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.830917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.831231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.832451] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.909640] env[65455]: INFO networking_nsxv3.common.synchronization [None req-789af24f-836e-4458-aa52-62d627c0988f tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1170.910516] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1170.910632] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.911130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.165178] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.165178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.165178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.165178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.165178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.165178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1171.197350] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.197350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.197350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.197350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.197350] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.206623] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1171.355245] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.355464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.355599] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.355714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.356071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.356071] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f already deleted. [ 1171.356071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.356637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.356637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.356637] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.879615] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.879615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.879615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.879615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.879615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.879615] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f already deleted. [ 1171.879615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.086831] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: SUCCESS [ 1172.087205] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.380891] env[65455]: INFO networking_nsxv3.common.synchronization [req-8aa465c1-4c51-4f02-b8c8-18bc1962a0a7 req-be202eec-ea24-4d76-9fda-e74758e066e8 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1172.381691] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1172.381998] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.382917] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.383475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.383807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.384029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.384029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.384427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.384720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.384720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.384849] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.763925] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.764195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.764340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.764647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.764929] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.765231] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.765387] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.765681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.765900] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.766196] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.766395] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.766529] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.766685] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.766833] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.767090] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.767240] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.787945] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.788176] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1172.788856] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.788856] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.788856] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-4b9263dd-f9c6-4141-9920-06873dc6f083 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.789112] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.789304] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.789547] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.789787] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b9263dd-f9c6-4141-9920-06873dc6f083',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.887911] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.888138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.888218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.890431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.890533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.890759] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.890942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.890942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.891133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.891239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.891277] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f already deleted. [ 1172.891347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.216978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 4s [ 1173.292493] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.292750] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.292841] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.293151] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.293308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.293466] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 4b9263dd-f9c6-4141-9920-06873dc6f083 not found, creating... [ 1173.293736] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.293904] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.294100] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.294259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.294392] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.294792] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.294977] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.295110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.295324] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.295456] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.295593] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 4b9263dd-f9c6-4141-9920-06873dc6f083 is going to be created. [ 1173.316942] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.317182] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.317308] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.317580] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.317813] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.318093] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.026194] env[65455]: INFO networking_nsxv3.common.synchronization [req-8aa465c1-4c51-4f02-b8c8-18bc1962a0a7 req-ee401c37-f35e-4a3a-9124-7fd1e9b22e91 service nova] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_rules [ 1174.026462] env[65455]: INFO networking_nsxv3.common.synchronization [req-8aa465c1-4c51-4f02-b8c8-18bc1962a0a7 req-ee401c37-f35e-4a3a-9124-7fd1e9b22e91 service nova] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1174.026717] env[65455]: INFO networking_nsxv3.common.synchronization [req-8aa465c1-4c51-4f02-b8c8-18bc1962a0a7 req-ee401c37-f35e-4a3a-9124-7fd1e9b22e91 service nova] Enqueued Resource ID: 4b9263dd-f9c6-4141-9920-06873dc6f083 with Priority: HIGHEST for action port [ 1174.027300] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_rules [ 1174.027423] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1174.027796] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9263dd-f9c6-4141-9920-06873dc6f083 with Priority: HIGHEST for action port [ 1174.028107] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.028234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.028316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.028591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.030880] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.030880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.030880] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.030880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.031213] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.033098] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b9263dd-f9c6-4141-9920-06873dc6f083 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.034745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.034745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.034745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.034745] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b9263dd-f9c6-4141-9920-06873dc6f083',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.533441] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.536889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.536889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.536889] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b9263dd-f9c6-4141-9920-06873dc6f083 with status ACTIVE [ 1174.536889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.536889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.536889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.537329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.537329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.537329] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.537420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.537544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.537671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.537729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.537938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.538061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.538138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.538355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.538398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.539013] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b9263dd-f9c6-4141-9920-06873dc6f083 is going to be updated. [ 1174.560828] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.561093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.561173] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.561381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.561915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.561915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b9263dd-f9c6-4141-9920-06873dc6f083" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.037053] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.228305] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1175.228305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.228472] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.228704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.228899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.229061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.229157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.229332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.229415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.229503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.229595] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.538637] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.538804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.538866] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.539246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.539246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.539394] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be created. [ 1175.564100] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.564349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.564349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.564560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.564721] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.574055] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: UNINITIALIZED for 2s [ 1175.732082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.732312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.732419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.732666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.732867] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.732998] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.733081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.733236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.733322] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.733410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.733557] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.733643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.733703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.733837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.733976] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.734082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.734134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.734262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.734337] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.734416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.734503] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.237015] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd1120c8-14cf-47d8-87d2-dfaa63f749d7: rpc.has_security_group_logging(os_id): False [ 1176.256051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.256213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.256287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.256598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.256695] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.256896] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.257028] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.257094] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.257249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.257316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.257645] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.257712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.257803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.258171] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.258316] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.258469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.258566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.258627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.258773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.258845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.258929] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1176.355257] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.355477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.355477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.355666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.355825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.370114] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1176.553680] env[65455]: INFO networking_nsxv3.common.synchronization [req-ed4117d9-11cb-4477-b78f-1665e3559e8d req-b954c324-81fc-47a5-81b0-996a5010a200 tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1176.553680] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1176.553680] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.554847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.557118] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.557118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.557118] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.921912] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-30 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.922147] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.922298] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.922608] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.922915] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.923116] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.923245] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.923474] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.923622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.923829] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.923963] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.924125] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.924271] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.924389] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.924494] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.924623] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.943820] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.944018] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.944170] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.944345] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.944640] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-596946f9-ad13-4f22-931d-8f7a41991089 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.944810] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.944916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.945251] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.945385] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596946f9-ad13-4f22-931d-8f7a41991089',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.060588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.060765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.060805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.061305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.061305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.061414] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.061512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.061567] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.061710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.061787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.061875] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1177.088719] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.088923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.088923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.089149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.089293] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.100101] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1177.448472] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.448472] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.448472] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.448937] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.448976] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.449142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 596946f9-ad13-4f22-931d-8f7a41991089 not found, creating... [ 1177.449413] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.449645] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.449802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.450159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.450388] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.450714] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.450942] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.451110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.451401] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.451576] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.451793] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 596946f9-ad13-4f22-931d-8f7a41991089 is going to be created. [ 1177.472344] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.472565] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.472693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.473015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.473263] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.473578] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.584933] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1177.585825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.585949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.586154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.586359] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.586704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.586704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.586704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.586812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.586859] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.586921] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.089860] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.090069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.090069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.090318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.090491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.090613] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.090656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.090791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.090875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.090963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.091133] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.091278] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.091373] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.091494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.091665] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.091763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.091844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.092032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.092129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.092480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.092480] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.179714] env[65455]: INFO networking_nsxv3.common.synchronization [req-ed4117d9-11cb-4477-b78f-1665e3559e8d req-3b2e9c07-4552-4f78-a955-9d6884e04904 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1178.179891] env[65455]: INFO networking_nsxv3.common.synchronization [req-ed4117d9-11cb-4477-b78f-1665e3559e8d req-3b2e9c07-4552-4f78-a955-9d6884e04904 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1178.180231] env[65455]: INFO networking_nsxv3.common.synchronization [req-ed4117d9-11cb-4477-b78f-1665e3559e8d req-3b2e9c07-4552-4f78-a955-9d6884e04904 service nova] Enqueued Resource ID: 596946f9-ad13-4f22-931d-8f7a41991089 with Priority: HIGHEST for action port [ 1178.180801] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1178.180972] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1178.181136] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 596946f9-ad13-4f22-931d-8f7a41991089 with Priority: HIGHEST for action port [ 1178.181469] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.181623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.181701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.181947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.182075] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.183056] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.183142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.183331] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-596946f9-ad13-4f22-931d-8f7a41991089 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.183435] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.183495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.183781] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.183781] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596946f9-ad13-4f22-931d-8f7a41991089',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.386632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1178.386878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.594939] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 039ffcce-1e26-4901-80d8-4b8e0ee79d6f: rpc.has_security_group_logging(os_id): False [ 1178.614126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.614332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.614384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.614584] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.614671] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.614881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.614979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.615065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.615214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.615291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.615472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.615564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.615625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.615761] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.615832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.616025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.616121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.616180] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.616318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.616390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.616475] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be created. [ 1178.673503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.673733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.673733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.673952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.674159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.683952] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1178.685338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.685506] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.685597] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 596946f9-ad13-4f22-931d-8f7a41991089 with status ACTIVE [ 1178.685754] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.685844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.686203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.686203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.686203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.686345] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.686440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.686493] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.686651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.686727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.686904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.686989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.687061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.687198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.687330] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.687377] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 596946f9-ad13-4f22-931d-8f7a41991089 is going to be updated. [ 1178.706988] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.707213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.707213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.707497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.707549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.707675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.109138] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1179.109293] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef deletion is rescheduled due to dependency. [ 1179.109406] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.109569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.109799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.110025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.110150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.110218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.110384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.110512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.110577] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.612681] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.653529] env[65455]: INFO networking_nsxv3.common.synchronization [req-1db4b576-9f26-4cf2-a890-6c49efe75e8b req-634f34a5-e8da-490d-889e-e1747570cccf tempest-ServersNegativeTestJSON-692253222 tempest-ServersNegativeTestJSON-692253222-project-member] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1179.654378] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1179.654986] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.655093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.655256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.655543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.658423] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.658423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.658423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.658423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.658423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.658423] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.115756] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.160643] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.618415] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.618821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.618821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.618960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.618960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.619146] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1180.648888] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.649069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.649203] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.649324] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.649474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.659615] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1180.663044] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.702056] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1180.702308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.165200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.165411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.165463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.165664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.165756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.165860] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1181.203343] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.203539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.203539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.203754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.203901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.213189] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1182.674035] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1182.674035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.674533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.674533] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.674664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.674838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.674910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.675217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.675325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.675465] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.675575] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.179545] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.226027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 4s [ 1183.362279] env[65455]: INFO networking_nsxv3.common.synchronization [req-cce4a3f8-b840-4e49-b374-4f27339177f4 req-1e4479be-5a5e-4169-9761-3c13ee2beff8 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1183.362616] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1183.363122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.363258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.363661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.363661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.363744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.363796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.363851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.364089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.364146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.364192] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.681913] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 1183.690650] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.690889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.691010] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.691320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.691582] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.691744] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.691862] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.692254] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.692460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.692690] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.692808] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.692920] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.693068] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.693213] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.693327] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.693464] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.701301] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.701436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.701491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.701686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.701777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.702038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.702148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.702232] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.702429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.702575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.702575] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1183.713071] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.713290] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.713441] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.713614] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.713912] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.714099] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.714226] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.714537] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.714676] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc82fbf-2b04-41c4-ba4f-50c24b455f73',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.770745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.770948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.770948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.771196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.771346] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.783677] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1183.867534] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.867755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.867831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.868129] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.868231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.869032] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.869032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.869032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.869032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.869032] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.869032] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f already deleted. [ 1183.869431] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.220405] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.220405] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 not found, creating... [ 1184.220405] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.220405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.220959] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.220959] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.220959] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.221425] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.221729] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.221980] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 is going to be created. [ 1184.252029] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.252029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.252029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.252029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.252029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.252029] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.963644] env[65455]: INFO networking_nsxv3.common.synchronization [req-cce4a3f8-b840-4e49-b374-4f27339177f4 req-e525a1a6-c8c2-4a2c-bc0f-a62f747da5b7 service nova] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1184.963896] env[65455]: INFO networking_nsxv3.common.synchronization [req-cce4a3f8-b840-4e49-b374-4f27339177f4 req-e525a1a6-c8c2-4a2c-bc0f-a62f747da5b7 service nova] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1184.963896] env[65455]: INFO networking_nsxv3.common.synchronization [req-cce4a3f8-b840-4e49-b374-4f27339177f4 req-e525a1a6-c8c2-4a2c-bc0f-a62f747da5b7 service nova] Enqueued Resource ID: 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 with Priority: HIGHEST for action port [ 1184.964455] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_rules [ 1184.964595] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1184.964694] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 with Priority: HIGHEST for action port [ 1184.964973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.965972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.965972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.965972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.965972] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.967141] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.967292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.967388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.967711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.967907] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.968073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.968170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.968388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.968479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.968596] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.969782] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.969933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.970453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.970665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.970907] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dc82fbf-2b04-41c4-ba4f-50c24b455f73',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.237179] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1185.237657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.468312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.469061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.473121] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 with status ACTIVE [ 1185.474664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.474664] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.474664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.475013] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.475013] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.475131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.475172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.475325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.475451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.475480] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dc82fbf-2b04-41c4-ba4f-50c24b455f73 is going to be updated. [ 1185.478908] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.505376] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.506221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.506221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.506221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.506221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.506221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dc82fbf-2b04-41c4-ba4f-50c24b455f73" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.800694] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1185.800891] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.984409] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.488224] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.488224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.488224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.488224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.488224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.488224] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f is going to be created. [ 1186.515561] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.515774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.515774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.515989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.516246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.527558] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: UNINITIALIZED for 2s [ 1188.539796] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: SUCCESS [ 1188.539796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.539796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.540400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.540400] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.540400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.540400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.540644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.540644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.540748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.540812] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.043524] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.546499] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f: rpc.has_security_group_logging(os_id): False [ 1189.566408] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.566565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.566680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.566857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.566948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.567202] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.567303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.567362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.567514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.567588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.567674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f is going to be created. [ 1189.625099] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.625271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.625271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.625474] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.625729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.636936] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: IN_PROGRESS for 2s [ 1189.965609] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1189.965833] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1190.281954] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3c0a13b-9f99-4696-b203-e9a1635fae6f req-662e0e76-e198-4005-bc98-09930663abd8 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1190.282591] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1190.282991] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.283552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.283552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.283552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.283552] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.283935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.283935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.283935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.284157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.284157] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.620232] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.620525] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.620589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.620909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.621199] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.621360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.621521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.621684] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.621829] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.622045] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.622158] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.622276] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.622370] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.622475] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.622584] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.622717] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.642835] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.642835] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1190.642835] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.643086] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.643259] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-02335059-e4ee-4d1e-a447-f887aa156f07 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.643427] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.643547] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.643869] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.644016] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02335059-e4ee-4d1e-a447-f887aa156f07',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.786156] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.786321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.786394] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.786650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.786744] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.786969] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.787069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.787127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.787283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.787366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.787456] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1190.813729] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.813877] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.813945] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.814186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.814331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.823732] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1191.146693] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.146926] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.147069] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.147361] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.147509] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.147666] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 02335059-e4ee-4d1e-a447-f887aa156f07 not found, creating... [ 1191.147928] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.148109] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.148257] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.148546] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.148693] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.148986] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.149162] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.149280] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.149495] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.149630] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.149772] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 02335059-e4ee-4d1e-a447-f887aa156f07 is going to be created. [ 1191.183409] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.183630] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.183756] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.184053] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.184601] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.184601] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.650558] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: SUCCESS [ 1191.650912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.891369] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3c0a13b-9f99-4696-b203-e9a1635fae6f req-646ce9cf-0b0e-4947-9aa4-f37004a41e4a service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1191.891656] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3c0a13b-9f99-4696-b203-e9a1635fae6f req-646ce9cf-0b0e-4947-9aa4-f37004a41e4a service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1191.891700] env[65455]: INFO networking_nsxv3.common.synchronization [req-f3c0a13b-9f99-4696-b203-e9a1635fae6f req-646ce9cf-0b0e-4947-9aa4-f37004a41e4a service nova] Enqueued Resource ID: 02335059-e4ee-4d1e-a447-f887aa156f07 with Priority: HIGHEST for action port [ 1191.894419] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1191.895549] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1191.895549] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02335059-e4ee-4d1e-a447-f887aa156f07 with Priority: HIGHEST for action port [ 1191.895549] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.895549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.895549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.895549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.895549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.896883] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.896989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.897339] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-02335059-e4ee-4d1e-a447-f887aa156f07 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.897459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.897587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.897787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.897868] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02335059-e4ee-4d1e-a447-f887aa156f07',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.400093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.400296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.400521] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02335059-e4ee-4d1e-a447-f887aa156f07 with status ACTIVE [ 1192.400692] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.400776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.400776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.400993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.401120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.401309] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.401405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.401464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.401625] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.401701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.401875] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.401965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.402034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.402175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.402248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.402333] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02335059-e4ee-4d1e-a447-f887aa156f07 is going to be updated. [ 1192.423903] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.424064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.424133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.424344] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.424476] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.424643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02335059-e4ee-4d1e-a447-f887aa156f07" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.834555] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1192.834810] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 deletion is rescheduled due to dependency. [ 1192.834848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.835447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.835447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.835447] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.835631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.835668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.836985] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.837123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.837236] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.340037] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.843015] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.345997] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.346258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.346401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.346731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.346880] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.347058] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1194.379038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.379219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.379271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.379464] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.379603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.389079] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1196.401142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1196.401446] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.401740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.402081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.402081] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.402212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.402258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.402497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.402597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.402748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.402853] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.866680] env[65455]: INFO networking_nsxv3.common.synchronization [None req-5ce15c68-a6eb-492a-b7fc-ed54af907429 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1196.867281] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1196.867759] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.867759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.867856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.868060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.868199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.868352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.868352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.868536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.868704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.868771] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.905959] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.906146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.371903] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.874600] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.377155] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.377365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.377438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.377655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.377745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.377850] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1198.411143] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.411332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.411405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.411631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.411777] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.421588] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1199.156787] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.157101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.157101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.157406] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.157612] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.158759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.158970] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.159269] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.159428] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.159652] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.159767] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.159874] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.159981] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.160107] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.160283] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.160420] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.181070] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.181325] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.181414] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.181591] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.182056] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-772d4214-475d-4253-bdbe-af193008763a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.182245] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.182329] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.182690] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.182859] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772d4214-475d-4253-bdbe-af193008763a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.685145] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.685356] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.685545] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.685830] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.685982] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.686152] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 772d4214-475d-4253-bdbe-af193008763a not found, creating... [ 1199.686417] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.686571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.686686] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.686914] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.687058] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.687337] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.687491] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.687604] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.687806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.687936] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.688094] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 772d4214-475d-4253-bdbe-af193008763a is going to be created. [ 1199.711975] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.712209] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.712316] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.712622] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.712886] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.713122] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.432429] env[65455]: INFO networking_nsxv3.common.synchronization [req-6ae8e391-5d4e-494b-b83f-c6d54e8bd7de req-f22b67b0-4f03-4385-ab5c-8725ead473b2 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1200.432866] env[65455]: INFO networking_nsxv3.common.synchronization [req-6ae8e391-5d4e-494b-b83f-c6d54e8bd7de req-f22b67b0-4f03-4385-ab5c-8725ead473b2 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1200.433103] env[65455]: INFO networking_nsxv3.common.synchronization [req-6ae8e391-5d4e-494b-b83f-c6d54e8bd7de req-f22b67b0-4f03-4385-ab5c-8725ead473b2 service nova] Enqueued Resource ID: 772d4214-475d-4253-bdbe-af193008763a with Priority: HIGHEST for action port [ 1200.433776] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1200.433949] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1200.434341] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 772d4214-475d-4253-bdbe-af193008763a with Priority: HIGHEST for action port [ 1200.434761] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.434826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.435058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.435161] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.435384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-772d4214-475d-4253-bdbe-af193008763a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.435513] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.435604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.435805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.435894] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('772d4214-475d-4253-bdbe-af193008763a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.457638] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1200.457803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.457969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.458239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.458472] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.458598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.458666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.458838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.458943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.459011] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.459176] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.459253] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.459321] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.459456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.459599] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.459693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.459748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.459888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.459963] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.460055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.460160] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.461262] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.461489] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.461653] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.461755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.461819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.461960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.462048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.462137] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.911285] env[65455]: INFO networking_nsxv3.common.synchronization [req-873c31e9-2c98-43de-b38b-60d04598a21d req-5ed766b6-97d2-427d-a90a-5348e8485aa8 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1200.911367] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1200.912122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.912122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.912122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.912122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.912273] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.912273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.912340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.912670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.912670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.912670] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.940622] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 772d4214-475d-4253-bdbe-af193008763a with status ACTIVE [ 1200.940622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.940622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.940622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.940622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.940622] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 772d4214-475d-4253-bdbe-af193008763a is going to be updated. [ 1200.964694] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.964812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.964854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.965144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.965371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.965627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-772d4214-475d-4253-bdbe-af193008763a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.965944] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba484ae0-86ee-48da-8cfe-e1829ca57af5: rpc.has_security_group_logging(os_id): False [ 1200.967312] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.985987] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.985987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.985987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.985987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.985987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.986196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.986280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.986280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.986433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.986510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.986688] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.986769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.986836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.986975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.987065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.987246] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.987342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.987402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.987544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.987618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.987700] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1201.073337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.073591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.073653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.073967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.074212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.088479] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1201.415402] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.415402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.415402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.415626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.415714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.415927] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.416034] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.416076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.416216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.416275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.416367] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be updated. [ 1201.446393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.446919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.446919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.446919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.447067] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.457310] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1201.470472] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.972779] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.973035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.973256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.973534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.973534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.973608] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1202.007199] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.007348] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.007419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.007639] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.007783] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.018327] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1203.107096] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1203.107439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.107698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.108012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.108171] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.467196] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1203.467390] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f deletion is rescheduled due to dependency. [ 1203.467508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.611440] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.611636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.029605] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1204.029815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.029987] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.030273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.030465] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.030580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.030645] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.030803] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.030881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.030964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.031072] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.534308] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.534694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.534694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.534865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.535050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.535174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.535257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.535402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.535488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.535577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.535724] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.535817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.535875] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.536020] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.536159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.536247] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.536302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.536438] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.536512] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.536592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.536680] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.039565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba484ae0-86ee-48da-8cfe-e1829ca57af5: rpc.has_security_group_logging(os_id): False [ 1205.057916] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.058149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.058149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.058359] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.058473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.058669] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.058767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.058829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.058980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.059069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.059247] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.059331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.059395] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.059530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.059603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.059841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.059999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.060116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.060332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.060409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.060496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1205.129031] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.129031] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.129200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.129404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.129626] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.146290] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1205.320462] env[65455]: INFO networking_nsxv3.common.synchronization [None req-50740743-e93c-4b16-b711-b11354b5c43e tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1205.321392] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1205.321771] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.321874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.321874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.322179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.322266] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.409640] env[65455]: INFO networking_nsxv3.common.synchronization [None req-46dbdeec-86e1-42df-855f-fd5a2c7b389e tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1205.410857] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1205.410857] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.410857] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.842968] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.843362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.843362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.843436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.843479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.843577] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 already deleted. [ 1205.843666] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.843817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.843973] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.844086] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.365951] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.366157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.366157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.366814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.366814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.366814] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 already deleted. [ 1206.366814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.163572] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1207.163951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.412488] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1210.412828] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1212.252788] env[65455]: INFO networking_nsxv3.common.synchronization [req-20addb87-dfbb-4081-a4e9-ed0bd7eab9cc req-77dd2c31-dc6f-4658-a925-8e1fa977da20 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1212.253685] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1212.254016] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.254155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.254242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.254478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.254635] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.254807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.254807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.254960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.255053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.255161] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.624574] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.624792] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.624942] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.625195] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.625519] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.629205] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.629440] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.629850] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.629914] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.630135] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.630283] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.630400] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.630514] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.630638] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.630748] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.630891] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.654355] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.654552] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.654552] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.654695] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.655131] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-2c07f015-1ab7-432e-9cd4-221f45fab0ec taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.655364] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.655575] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.655881] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.656080] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c07f015-1ab7-432e-9cd4-221f45fab0ec',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.757328] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.757557] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.757608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.757839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.757955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.758244] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.758360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.758502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.758622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.758703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.758792] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 already deleted. [ 1212.758873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.804382] env[65455]: INFO networking_nsxv3.common.synchronization [req-bc10fb4a-3306-417e-a57f-e4237eef467e req-568da10a-f081-4f9a-8d6e-a04317d6df60 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1212.805062] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1212.805393] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.805521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.805589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.805787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.805939] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.806044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.806107] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.806277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.806351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.806432] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.159262] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.159537] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.159639] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.159908] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.160090] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.160256] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 2c07f015-1ab7-432e-9cd4-221f45fab0ec not found, creating... [ 1213.160555] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.160723] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.160840] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.161116] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.161254] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.161540] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.161700] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.161812] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.162052] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.162200] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.162341] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 2c07f015-1ab7-432e-9cd4-221f45fab0ec is going to be created. [ 1213.185299] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.185617] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.185691] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.186045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.186268] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.186457] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.308747] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.329734] env[65455]: INFO networking_nsxv3.common.synchronization [None req-8f38af35-1c45-4135-afde-071e6e125863 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1213.330524] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1213.330863] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.330970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.811539] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.897817] env[65455]: INFO networking_nsxv3.common.synchronization [req-20addb87-dfbb-4081-a4e9-ed0bd7eab9cc req-094f7f51-6038-478d-8ebd-b704205f3e9d service nova] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1213.898083] env[65455]: INFO networking_nsxv3.common.synchronization [req-20addb87-dfbb-4081-a4e9-ed0bd7eab9cc req-094f7f51-6038-478d-8ebd-b704205f3e9d service nova] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1213.898272] env[65455]: INFO networking_nsxv3.common.synchronization [req-20addb87-dfbb-4081-a4e9-ed0bd7eab9cc req-094f7f51-6038-478d-8ebd-b704205f3e9d service nova] Enqueued Resource ID: 2c07f015-1ab7-432e-9cd4-221f45fab0ec with Priority: HIGHEST for action port [ 1213.898797] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_rules [ 1213.898935] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1213.899536] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c07f015-1ab7-432e-9cd4-221f45fab0ec with Priority: HIGHEST for action port [ 1213.899885] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.900066] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.900167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.900434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.900551] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.902047] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.902286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.902410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.902627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.902808] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.902934] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.903026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.903939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.904190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.904294] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.905730] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c07f015-1ab7-432e-9cd4-221f45fab0ec taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.905730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.905730] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.905871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.905871] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c07f015-1ab7-432e-9cd4-221f45fab0ec',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.314290] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.314538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.314619] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.314874] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.314981] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.315095] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1214.350830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.351054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.351054] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.351281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.351440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.360331] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1214.408124] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.409382] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.409537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.409720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c07f015-1ab7-432e-9cd4-221f45fab0ec with status ACTIVE [ 1214.409886] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.410019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.410096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.410355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.410496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.410801] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.410955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.411064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.411291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.411416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.411652] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.411772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.411854] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.412056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.412163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.412261] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c07f015-1ab7-432e-9cd4-221f45fab0ec is going to be updated. [ 1214.436093] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.436306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.436386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.436661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.436812] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.436978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c07f015-1ab7-432e-9cd4-221f45fab0ec" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.915272] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.418272] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.418635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.418635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.418746] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.418834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.418937] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 is going to be created. [ 1215.445584] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.445837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.445837] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.446075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.446255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.458667] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: UNINITIALIZED for 2s [ 1216.019989] env[65455]: INFO networking_nsxv3.common.synchronization [req-2aa7c310-cf21-4abb-843b-24e66a5456ee req-e0f662e0-34ec-4e20-81e7-a78787fcd745 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1216.020624] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGHEST for action security_group_members [ 1216.020961] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.021299] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.021396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.021610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.021776] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.022016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.022016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.022153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.022218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.022317] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.371344] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.373443] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.373443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.373443] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.525315] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.525665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.525665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.525920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.526065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.526237] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.526338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.526402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.526596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.526954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.526954] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 is going to be updated. [ 1216.562626] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.562843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.562843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.563096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.563261] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.574807] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: IN_PROGRESS for 2s [ 1216.877644] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.877939] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.878072] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.878462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.879585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.879585] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.879585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.879585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.879585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.879585] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.879585] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1216.910917] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.911114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.911220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.911616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.911773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.926545] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1217.474142] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: SUCCESS [ 1217.474396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.474492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.474713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.474899] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.475056] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.475312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.475312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.475312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.475463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.475463] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.978470] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.481307] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3665a01-cdc6-4c1e-8d6e-3891037fbac5: rpc.has_security_group_logging(os_id): False [ 1218.510570] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.510570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.510570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.510570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.511972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.511972] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.511972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.511972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.511972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.512332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.512332] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 is going to be created. [ 1218.588040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 in Status: SUCCESS [ 1218.588413] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 deletion is rescheduled due to dependency. [ 1218.588643] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.596322] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.596548] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.596637] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.596943] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.597246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.613463] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: IN_PROGRESS for 2s [ 1218.937665] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1218.937844] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 deletion is rescheduled due to dependency. [ 1218.937964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.631236] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: SUCCESS [ 1220.631635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.021370] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.021533] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1221.030526] env[65455]: INFO networking_nsxv3.common.synchronization [None req-06ccf372-20a7-4b87-83ae-a71203b1710e tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1221.031184] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1221.031527] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.031650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.031993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.031993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.032119] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.123077] env[65455]: INFO networking_nsxv3.common.synchronization [None req-6f165263-b179-4da2-b686-8545ac5eeaea tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1221.123960] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1221.124452] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.124559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.556303] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.556499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.556592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.556868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.556989] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.557123] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be already deleted. [ 1221.557218] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.557410] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.557608] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.557714] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.078301] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.078301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.078301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.078301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.078301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.078301] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be already deleted. [ 1222.078301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.125632] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.125951] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1226.700520] env[65455]: INFO networking_nsxv3.common.synchronization [req-6975b661-b9f9-46f7-893d-5131f55d30cc req-717fa6aa-c14f-4ea6-8e4d-aee1cf89bd09 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1226.700714] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1226.700894] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.701084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.701084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.701418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.701604] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.701707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.701765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.701909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.701997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.702129] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.012042] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.012249] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.012370] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.012637] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.012894] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.013062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.013178] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.013393] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.013537] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.013767] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.013888] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.014082] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.014224] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.014373] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.014486] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.014686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.036817] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.037023] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1227.037153] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.037357] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.037699] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-c5df9efb-a457-4604-956f-99ca634bf3d6 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.037869] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.037987] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.038432] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.038614] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5df9efb-a457-4604-956f-99ca634bf3d6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.204940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.205351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.205351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.205415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.205547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.205721] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.205832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.205909] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.206055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.206142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.206208] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be already deleted. [ 1227.206289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.541686] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.541957] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.542221] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.542611] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.542889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.543178] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port c5df9efb-a457-4604-956f-99ca634bf3d6 not found, creating... [ 1227.543878] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.543878] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.544051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.544394] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.544632] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.545094] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.545343] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.545537] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.545856] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.546096] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.546326] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: c5df9efb-a457-4604-956f-99ca634bf3d6 is going to be created. [ 1227.577014] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.577259] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.577383] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.577726] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.578014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.578322] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.266734] env[65455]: INFO networking_nsxv3.common.synchronization [req-6975b661-b9f9-46f7-893d-5131f55d30cc req-26c02fe7-ca18-4fff-a941-c7495ac6a80e service nova] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1228.266734] env[65455]: INFO networking_nsxv3.common.synchronization [req-6975b661-b9f9-46f7-893d-5131f55d30cc req-26c02fe7-ca18-4fff-a941-c7495ac6a80e service nova] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1228.267118] env[65455]: INFO networking_nsxv3.common.synchronization [req-6975b661-b9f9-46f7-893d-5131f55d30cc req-26c02fe7-ca18-4fff-a941-c7495ac6a80e service nova] Enqueued Resource ID: c5df9efb-a457-4604-956f-99ca634bf3d6 with Priority: HIGHEST for action port [ 1228.267574] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1228.267746] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1228.267861] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5df9efb-a457-4604-956f-99ca634bf3d6 with Priority: HIGHEST for action port [ 1228.268187] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.268313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.268391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.268609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.268698] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.269618] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.269739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.269804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.270485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.270485] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.270485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.270485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.270485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.270485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.270766] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.271705] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5df9efb-a457-4604-956f-99ca634bf3d6 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.272058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.272058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.272315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.272553] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5df9efb-a457-4604-956f-99ca634bf3d6',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.774667] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.775833] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.775969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.776171] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5df9efb-a457-4604-956f-99ca634bf3d6 with status ACTIVE [ 1228.776339] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.776453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.776537] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.776775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.776899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.777111] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.777234] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.777303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.777655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.777655] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.777774] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.777873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.777930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.779149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.779149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.779149] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5df9efb-a457-4604-956f-99ca634bf3d6 is going to be updated. [ 1228.801277] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.801451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.801545] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.801778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.801923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.802103] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5df9efb-a457-4604-956f-99ca634bf3d6" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.281165] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.380072] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.380275] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.380402] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.380727] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.380996] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.381178] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.381297] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.381562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.381803] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.382159] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.382306] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1229.382424] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1229.382541] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1229.382692] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1229.382991] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1229.382991] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1229.404135] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1229.404342] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1229.404500] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1229.404678] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-861" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.405115] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-c17c5377-b3f2-43d2-98f6-f06b83ad0234 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.405310] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.405433] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.405790] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.405928] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17c5377-b3f2-43d2-98f6-f06b83ad0234',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.784109] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.784109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.784345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.784345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.784469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.784579] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be created. [ 1229.809897] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.810069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.810127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.810339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.810527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.819297] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: UNINITIALIZED for 2s [ 1229.908605] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.908846] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.909369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.909369] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.909509] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.909710] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.909870] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.909986] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.910230] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.910368] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.910688] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.910841] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.910962] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.911189] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.911327] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.911461] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 is going to be updated. [ 1229.934207] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.934460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.934590] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.934882] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.935089] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.935332] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.863132] env[65455]: INFO networking_nsxv3.common.synchronization [req-1a8ea74e-b0b8-4d9e-baa8-795bd7cd9e0a req-68e4af99-94b0-4837-b13c-029a1f7291c9 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1230.864063] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGHEST for action security_group_members [ 1230.864437] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.864596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.864983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.864983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.865154] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.865241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.865287] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.865418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.865502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.865597] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.131693] env[65455]: INFO networking_nsxv3.common.synchronization [req-f49a7e0e-08c1-484c-acb5-01970ea0cac4 req-59c746df-7c66-4bfb-9a72-c3950d60b4b6 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1231.131922] env[65455]: INFO networking_nsxv3.common.synchronization [req-f49a7e0e-08c1-484c-acb5-01970ea0cac4 req-59c746df-7c66-4bfb-9a72-c3950d60b4b6 service nova] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1231.135221] env[65455]: INFO networking_nsxv3.common.synchronization [req-f49a7e0e-08c1-484c-acb5-01970ea0cac4 req-59c746df-7c66-4bfb-9a72-c3950d60b4b6 service nova] Enqueued Resource ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 with Priority: HIGHEST for action port [ 1231.135221] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_rules [ 1231.135221] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1231.135221] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 with Priority: HIGHEST for action port [ 1231.135221] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.135221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.135221] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.135221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.135654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.135654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.135654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.135654] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.135769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.135769] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.136690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-c17c5377-b3f2-43d2-98f6-f06b83ad0234 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.136802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.136850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.136992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.137083] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c17c5377-b3f2-43d2-98f6-f06b83ad0234',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.368113] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.368532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.368712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.369029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.369226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.369868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.370144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.370389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.370702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.370890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.371078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe is going to be updated. [ 1231.402107] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.402268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.402307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.402571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.402811] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.412428] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: IN_PROGRESS for 2s [ 1231.638843] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.638984] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.639221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.640321] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c17c5377-b3f2-43d2-98f6-f06b83ad0234 with status ACTIVE [ 1231.640414] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.640529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.640600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.640876] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.640927] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.641075] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.642037] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.642037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.642522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c17c5377-b3f2-43d2-98f6-f06b83ad0234 is going to be updated. [ 1231.664830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.665022] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.665097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.665259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.665389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.665566] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c17c5377-b3f2-43d2-98f6-f06b83ad0234" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.831137] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1231.831382] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.831701] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.831800] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.832012] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.832142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.832210] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.832372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.832452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.832539] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.832633] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.144010] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.335073] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.646700] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.646971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.646971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.647160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.647250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.647353] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1232.678841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.679092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.679092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.679307] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.679451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.689353] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1232.838406] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ffa055-bd42-40f4-8ddc-b843644594be: rpc.has_security_group_logging(os_id): False [ 1232.856975] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.857251] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.857343] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.857598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.857732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.858063] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.858184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.858263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.858507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.858644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.858827] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be created. [ 1232.918648] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.918869] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.918920] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.919160] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.919366] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.932125] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1233.423836] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe in Status: SUCCESS [ 1233.424283] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe deletion is rescheduled due to dependency. [ 1233.424283] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.699988] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1234.700266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.700419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.700830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.701059] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.701273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.701403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.701679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.701822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.701929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.702048] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.944348] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1234.944591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.205025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.205249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.205305] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.205596] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.205817] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.205964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.206048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.206200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.206290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.206398] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.206560] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.206653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.206711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.206853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.207024] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.207132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.207188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.207320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.207388] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.207469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.207562] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.710431] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd1120c8-14cf-47d8-87d2-dfaa63f749d7: rpc.has_security_group_logging(os_id): False [ 1235.734835] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.735139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.735281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.735603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.735775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.736100] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.736374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.736507] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.736786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.736991] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.737321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.737530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.737681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.737947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.738136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.738537] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.738693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.738850] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.739117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.739296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.739479] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1235.827404] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.827592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.827732] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.827955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.828206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.860014] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1236.021635] env[65455]: INFO networking_nsxv3.common.synchronization [None req-d485aae6-c8c7-4395-bfac-120daa26ddc4 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1236.021954] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1236.022579] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.022733] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.022810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.023087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.023226] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.188726] env[65455]: INFO networking_nsxv3.common.synchronization [None req-de3d6d31-dfd9-4809-bfe5-31dc5e5ccdd6 tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1236.189600] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1236.190417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.190631] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.547477] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.547731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.547872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.548223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.548347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.548517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f already deleted. [ 1236.548705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.549273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.549779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.550195] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.076718] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.077142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.077142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.077280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.077371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.077468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f already deleted. [ 1237.077565] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.876937] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1237.877600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.190845] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.191273] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1241.670668] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.670903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.670903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.671326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.671614] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.671804] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.671929] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.672231] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.672390] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.672685] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.672806] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1241.672949] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1241.673150] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1241.673349] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1241.673523] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1241.673741] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1241.695409] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1241.695613] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1241.695715] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1241.695959] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-857" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.696319] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-a73afdc1-3123-4891-9d25-17c7c9a7303f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.696510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.696633] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.696968] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.697144] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73afdc1-3123-4891-9d25-17c7c9a7303f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.200840] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.201277] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.201277] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.201513] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.201858] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.202202] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.202373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.202525] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.202802] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.203051] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.203385] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.203590] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.203726] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.203956] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.204132] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.204288] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: a73afdc1-3123-4891-9d25-17c7c9a7303f is going to be updated. [ 1242.224630] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.224846] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.224971] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.225262] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.225464] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.225790] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.958054] env[65455]: INFO networking_nsxv3.common.synchronization [req-cdbeda81-4e65-4e5f-ba57-24c4fb947860 req-b97be35d-949d-4833-9bbf-c25fdee23328 service nova] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1242.958246] env[65455]: INFO networking_nsxv3.common.synchronization [req-cdbeda81-4e65-4e5f-ba57-24c4fb947860 req-b97be35d-949d-4833-9bbf-c25fdee23328 service nova] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1242.958384] env[65455]: INFO networking_nsxv3.common.synchronization [req-cdbeda81-4e65-4e5f-ba57-24c4fb947860 req-b97be35d-949d-4833-9bbf-c25fdee23328 service nova] Enqueued Resource ID: a73afdc1-3123-4891-9d25-17c7c9a7303f with Priority: HIGHEST for action port [ 1242.959287] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_rules [ 1242.959444] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1242.959605] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73afdc1-3123-4891-9d25-17c7c9a7303f with Priority: HIGHEST for action port [ 1242.960095] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.960267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.960342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.960656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.960748] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.961852] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.962113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.962237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.962442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.962646] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.962773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.962861] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.963071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.963197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.963336] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.964869] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a73afdc1-3123-4891-9d25-17c7c9a7303f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.965068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.965068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.965217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.965330] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a73afdc1-3123-4891-9d25-17c7c9a7303f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.467567] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.469036] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.469036] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.469207] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a73afdc1-3123-4891-9d25-17c7c9a7303f with status ACTIVE [ 1243.469379] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.469505] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.469572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.469821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.469952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.470197] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.470432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.470511] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.470692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.470773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.471231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.471231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.471231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.471460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.471460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.471534] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a73afdc1-3123-4891-9d25-17c7c9a7303f is going to be updated. [ 1243.496073] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.496488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.496488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.496576] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.496789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.496862] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a73afdc1-3123-4891-9d25-17c7c9a7303f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.973861] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.476923] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.477716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.477716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.477716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.477716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.478130] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 is going to be updated. [ 1244.519186] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.519411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.519411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.520016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.520016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.533262] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: IN_PROGRESS for 2s [ 1244.603656] env[65455]: INFO networking_nsxv3.common.synchronization [req-86e47f0a-4c58-4b15-925c-cea165180565 req-545d788f-cc1c-4476-8afe-acf4633adb4a tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1244.604252] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1244.604569] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.604696] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.604767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.604964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.605130] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.605248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.605292] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.605445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.605531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.605623] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.928464] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.928723] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.928855] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.929137] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.929402] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.929575] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.929737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.930035] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.930188] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.930404] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.930518] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1244.930655] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1244.930769] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1244.930879] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1244.930984] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1244.931128] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1244.950351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1244.950480] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1244.950731] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1244.950924] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.951269] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-86d767ba-6757-4de4-a18e-f334a70da060 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.951460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.951581] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.951916] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.952194] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d767ba-6757-4de4-a18e-f334a70da060',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.107724] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.457167] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.457517] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.457653] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.459943] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port 86d767ba-6757-4de4-a18e-f334a70da060 not found, creating... [ 1245.459943] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.459943] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.459943] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.460404] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.460404] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.460404] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.460404] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: 86d767ba-6757-4de4-a18e-f334a70da060 is going to be created. [ 1245.481446] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.481835] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.481835] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.482054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.482287] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.482506] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.610665] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.113806] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.114105] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.114204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.114523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.114669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.114818] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be updated. [ 1246.160179] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.160372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.160426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.160822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.161019] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.170265] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1246.274149] env[65455]: INFO networking_nsxv3.common.synchronization [req-86e47f0a-4c58-4b15-925c-cea165180565 req-7953a72f-2a3d-405a-928f-1b226e31a62c service nova] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1246.274405] env[65455]: INFO networking_nsxv3.common.synchronization [req-86e47f0a-4c58-4b15-925c-cea165180565 req-7953a72f-2a3d-405a-928f-1b226e31a62c service nova] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1246.274555] env[65455]: INFO networking_nsxv3.common.synchronization [req-86e47f0a-4c58-4b15-925c-cea165180565 req-7953a72f-2a3d-405a-928f-1b226e31a62c service nova] Enqueued Resource ID: 86d767ba-6757-4de4-a18e-f334a70da060 with Priority: HIGHEST for action port [ 1246.275457] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_rules [ 1246.275573] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1246.275702] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86d767ba-6757-4de4-a18e-f334a70da060 with Priority: HIGHEST for action port [ 1246.276066] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.276227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.276302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.276547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.276647] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.278794] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.278865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.279244] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-86d767ba-6757-4de4-a18e-f334a70da060 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.279364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.279427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.280523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.280523] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d767ba-6757-4de4-a18e-f334a70da060',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.544875] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: SUCCESS [ 1246.545258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.545384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.545693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.545952] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.546119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.546238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.546453] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.546640] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.546752] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.547038] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.744545] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ee16f3d-267e-4756-a69b-d102fa0871c5 req-a7335435-c4fe-4221-8c80-1b32fc1b4bfd tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1246.745200] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1246.745200] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.745547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.745547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.745716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.745905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.746076] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.746158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.746300] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.746392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.746486] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.778981] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.779163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.782507] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86d767ba-6757-4de4-a18e-f334a70da060 with status ACTIVE [ 1246.782668] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.782795] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.782863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.783080] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.783169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.783342] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.783439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.783500] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.783648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.783724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.783905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.783997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.784077] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.784217] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.784289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.784372] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86d767ba-6757-4de4-a18e-f334a70da060 is going to be updated. [ 1246.826239] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.826418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.826460] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.826664] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.826806] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.827058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86d767ba-6757-4de4-a18e-f334a70da060" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.051202] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.067661] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-507 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.067979] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.068106] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.068372] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.068672] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.068836] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.069054] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.069178] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.069312] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.069512] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.069626] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1247.069755] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1247.069887] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1247.070027] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1247.070431] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1247.070431] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1247.098741] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1247.098966] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1247.099093] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1247.099268] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-507" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.101014] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-a5a63678-0371-4821-94a0-584ec2b3c00a taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.101014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.101014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.101014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.101014] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5a63678-0371-4821-94a0-584ec2b3c00a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.249097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.249296] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.249339] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.249559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.249651] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.249862] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.249959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.250033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.250192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.250268] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.250353] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f already deleted. [ 1247.250433] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.553864] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92fa1390-194c-4487-a7c0-cfbabb347759: rpc.has_security_group_logging(os_id): False [ 1247.574860] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.575059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.575170] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.575439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.575577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.575882] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.576092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.576156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.576312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.576396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.576515] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 is going to be updated. [ 1247.603358] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.603571] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.603687] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.603985] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.604168] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.604327] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port a5a63678-0371-4821-94a0-584ec2b3c00a not found, creating... [ 1247.604592] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.604750] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.604865] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.605101] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.605234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.605513] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.605666] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.605779] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.605984] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.606133] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.606321] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: a5a63678-0371-4821-94a0-584ec2b3c00a is going to be created. [ 1247.626907] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.627131] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.627254] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.627583] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.627839] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.628117] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.638145] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.638289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.638393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.638610] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.638740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.654967] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: IN_PROGRESS for 2s [ 1248.180216] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1248.180592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.180952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.181328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.181699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.181929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.182062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.182310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.182443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.182596] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.333927] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ee16f3d-267e-4756-a69b-d102fa0871c5 req-f99e396a-c89b-4fd8-8313-67007a7293cc service nova] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1248.334172] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ee16f3d-267e-4756-a69b-d102fa0871c5 req-f99e396a-c89b-4fd8-8313-67007a7293cc service nova] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1248.334578] env[65455]: INFO networking_nsxv3.common.synchronization [req-7ee16f3d-267e-4756-a69b-d102fa0871c5 req-f99e396a-c89b-4fd8-8313-67007a7293cc service nova] Enqueued Resource ID: a5a63678-0371-4821-94a0-584ec2b3c00a with Priority: HIGHEST for action port [ 1248.334889] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_rules [ 1248.335325] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1248.335494] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5a63678-0371-4821-94a0-584ec2b3c00a with Priority: HIGHEST for action port [ 1248.335930] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.335930] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.336024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.336248] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.336350] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.338029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.338029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.338029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.338182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.338381] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.338381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.338652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.338652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.338711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.338805] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.340462] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5a63678-0371-4821-94a0-584ec2b3c00a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.340686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.340686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.341523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.341641] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5a63678-0371-4821-94a0-584ec2b3c00a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.686050] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.841642] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.844474] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.844712] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.844886] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5a63678-0371-4821-94a0-584ec2b3c00a with status ACTIVE [ 1248.845077] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.845235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.845309] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.845521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.845609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.845775] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.845868] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.845948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.846127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.846204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.846417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.846541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.846657] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.846836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.846913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.847000] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5a63678-0371-4821-94a0-584ec2b3c00a is going to be updated. [ 1248.868705] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.868890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.868890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.869159] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.869353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.869524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5a63678-0371-4821-94a0-584ec2b3c00a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.188679] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.344166] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.669279] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: SUCCESS [ 1249.669575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.691419] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.691830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.691830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.691980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.692116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.692252] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be updated. [ 1249.719511] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.719745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.719788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.720198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.720198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.729440] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1249.847366] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.847543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.847587] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.847810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.847916] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.848087] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f is going to be created. [ 1249.875463] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.875689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.875689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.875912] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.876154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.887528] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: UNINITIALIZED for 2s [ 1251.742080] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1251.742469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.742469] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.742692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.742889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.743024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.743093] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.743286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.743368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.743456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.743547] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.900118] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: SUCCESS [ 1251.900118] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.900291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.900407] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.900602] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.900757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.900821] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.900982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.901085] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.901176] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.901268] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.246063] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.403867] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.748786] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26ffa055-bd42-40f4-8ddc-b843644594be: rpc.has_security_group_logging(os_id): False [ 1252.768226] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.768419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.768499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.768716] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.768825] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.769107] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.769249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.769802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.769802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.769802] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.769802] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be updated. [ 1252.831142] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.831345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.831345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.831559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.831706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.849686] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1252.906233] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3589c8d-1936-4d03-9343-f38b88e5f54f: rpc.has_security_group_logging(os_id): False [ 1252.925312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.925521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.925521] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.925679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.925775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.926028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.926138] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.926201] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.926378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.926454] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.926543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f is going to be created. [ 1253.018491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.018714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.018714] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.018958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.019198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.032347] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: IN_PROGRESS for 2s [ 1253.336675] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.336837] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1253.342694] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-30 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.342959] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.343130] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.343551] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.343781] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.343995] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.344173] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.344440] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.344626] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.344920] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.345091] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.345283] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.345524] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.345628] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.345791] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.345949] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.371047] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.371047] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1253.371047] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.371320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-30" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.371494] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-596946f9-ad13-4f22-931d-8f7a41991089 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.371603] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.371795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.372070] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.372211] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596946f9-ad13-4f22-931d-8f7a41991089',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.874619] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.875073] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.875267] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.875687] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.875970] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.876390] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.876621] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.876796] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.877091] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.877260] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.877652] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.877889] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.878066] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.878334] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.878521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.878720] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 596946f9-ad13-4f22-931d-8f7a41991089 is going to be updated. [ 1253.901425] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.901629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.901761] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.902160] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.902505] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.902806] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.615525] env[65455]: INFO networking_nsxv3.common.synchronization [req-1fd97c19-2034-4f6b-8a50-cfee72027d0f req-ab86859f-2b18-48d2-8da8-36665f661e21 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1254.615721] env[65455]: INFO networking_nsxv3.common.synchronization [req-1fd97c19-2034-4f6b-8a50-cfee72027d0f req-ab86859f-2b18-48d2-8da8-36665f661e21 service nova] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1254.615861] env[65455]: INFO networking_nsxv3.common.synchronization [req-1fd97c19-2034-4f6b-8a50-cfee72027d0f req-ab86859f-2b18-48d2-8da8-36665f661e21 service nova] Enqueued Resource ID: 596946f9-ad13-4f22-931d-8f7a41991089 with Priority: HIGHEST for action port [ 1254.616554] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_rules [ 1254.616705] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1254.616821] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 596946f9-ad13-4f22-931d-8f7a41991089 with Priority: HIGHEST for action port [ 1254.617720] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.617888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.617952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.618178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.618321] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.620065] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.620214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.620288] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.620473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.620656] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.620789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.620849] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.621047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.621123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.621238] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.622124] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-596946f9-ad13-4f22-931d-8f7a41991089 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.622206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.622277] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.622432] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.622508] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596946f9-ad13-4f22-931d-8f7a41991089',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.871164] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1254.871383] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.045345] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: SUCCESS [ 1255.045768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.124427] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.124611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.124828] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.128630] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 596946f9-ad13-4f22-931d-8f7a41991089 with status ACTIVE [ 1255.128777] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.129622] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.129622] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.130038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.130038] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.130038] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.130144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.130172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.130310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.130405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.130496] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 596946f9-ad13-4f22-931d-8f7a41991089 is going to be updated. [ 1255.152371] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.152690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.152690] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.152822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.152954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.153208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-596946f9-ad13-4f22-931d-8f7a41991089" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.627922] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.131228] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.131606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.131606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.131739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.131894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.132040] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1256.164022] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.164260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.164260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.164520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.164707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.174602] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1258.047389] env[65455]: INFO networking_nsxv3.common.synchronization [None req-cb661352-9a64-43f7-a802-4cbbf2b0d4d6 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1258.047948] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1258.048263] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.048378] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.048440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.048633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.048788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.048888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.048947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.051682] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.051911] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.051989] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.188204] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1258.188430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.188598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.188819] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.189055] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.189184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.189269] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.189429] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.189520] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.189615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.189710] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.305954] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1258.306123] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:3 started [ 1258.555064] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.555762] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.555952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.556452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.556793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.557024] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.557254] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.557386] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.557713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.557831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.557996] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1258.592659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.592659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.592659] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.593145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.593331] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.605964] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1258.696037] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.198109] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d88d984-b158-405e-922b-bf70bddac6ef: rpc.has_security_group_logging(os_id): False [ 1259.223562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.223731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.223873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.224137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.224263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.224552] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.224686] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.224757] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.224952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.225071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.225202] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1259.317335] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.317588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.317588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.317766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.317967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.332098] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1260.617046] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1260.617413] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 deletion is rescheduled due to dependency. [ 1260.617413] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.347204] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1261.347524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.049208] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.049590] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.209732] env[65455]: INFO networking_nsxv3.common.synchronization [req-0292d528-ac6d-4c56-b9de-efffc37c93e4 req-0574ba43-b262-4c35-ba0e-4b7d03ae51df tempest-ServersNegativeTestJSON-692253222 tempest-ServersNegativeTestJSON-692253222-project-member] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1265.210621] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGHEST for action security_group_members [ 1265.211582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.211582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.211582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.211582] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.211582] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.211898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.211898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.211972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.212082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.212217] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.715380] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.715589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.715589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.715839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.715933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.716141] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.716243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.716306] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.716463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.716541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.716625] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be updated. [ 1265.747207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.747421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.747421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.747609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.747742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.758065] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: IN_PROGRESS for 2s [ 1267.773358] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 in Status: SUCCESS [ 1267.773703] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 deletion is rescheduled due to dependency. [ 1267.773703] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.211607] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.211987] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1273.732259] env[65455]: INFO networking_nsxv3.common.synchronization [req-963dbc57-1558-46bf-8a55-d9b002eea7a5 req-8ae085b6-989b-459a-8081-5ec97d5cb26c tempest-ServerActionsTestOtherB-879946144 tempest-ServerActionsTestOtherB-879946144-project-member] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1273.733044] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGHEST for action security_group_members [ 1273.733219] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.733401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.733496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.733728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.734045] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.734202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.734340] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.734621] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.734826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.735044] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.238993] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.238993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.238993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.238993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.238993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.238993] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.238993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.239455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.239455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.239455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.239455] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be updated. [ 1274.270266] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.270409] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.270503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.270795] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.271086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.280330] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: IN_PROGRESS for 2s [ 1274.828878] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.829234] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.829287] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.829536] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.829801] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.829960] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.830093] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.830320] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.830469] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.830724] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.830854] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.830957] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.831214] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.831214] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.831341] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.831416] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.850378] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.850519] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.850623] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.850817] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.851196] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-d1e3ea81-c174-445b-8347-b410d81bbc0d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.851402] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.851540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.851848] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.852023] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e3ea81-c174-445b-8347-b410d81bbc0d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.355099] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.355340] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.355467] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.355747] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.355896] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.356076] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port d1e3ea81-c174-445b-8347-b410d81bbc0d not found, creating... [ 1275.356348] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.356511] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.356627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.356869] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.357017] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.357306] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.357460] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.357572] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.357782] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.357914] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.358065] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: d1e3ea81-c174-445b-8347-b410d81bbc0d is going to be created. [ 1275.378257] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.378510] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.378658] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.379038] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.379290] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.379521] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.069034] env[65455]: INFO networking_nsxv3.common.synchronization [req-a58b906e-2ce9-4b41-8784-1a156e6f59dc req-d865b4b8-5ffd-49b0-8faf-2ae45fa59178 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1276.069286] env[65455]: INFO networking_nsxv3.common.synchronization [req-a58b906e-2ce9-4b41-8784-1a156e6f59dc req-d865b4b8-5ffd-49b0-8faf-2ae45fa59178 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1276.069355] env[65455]: INFO networking_nsxv3.common.synchronization [req-a58b906e-2ce9-4b41-8784-1a156e6f59dc req-d865b4b8-5ffd-49b0-8faf-2ae45fa59178 service nova] Enqueued Resource ID: d1e3ea81-c174-445b-8347-b410d81bbc0d with Priority: HIGHEST for action port [ 1276.070092] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1276.070538] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1276.070650] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e3ea81-c174-445b-8347-b410d81bbc0d with Priority: HIGHEST for action port [ 1276.070955] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.071101] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.071168] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.071379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.071480] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.072940] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.073154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.073154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.073325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.073477] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.074109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.074140] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.074345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.074387] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.074516] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.076225] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e3ea81-c174-445b-8347-b410d81bbc0d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.076352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.076421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.076580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.076657] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e3ea81-c174-445b-8347-b410d81bbc0d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.291741] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d88d984-b158-405e-922b-bf70bddac6ef in Status: SUCCESS [ 1276.291972] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef deletion is rescheduled due to dependency. [ 1276.292146] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.573788] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.573980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.576240] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.578159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1e3ea81-c174-445b-8347-b410d81bbc0d with status ACTIVE [ 1276.578159] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.578265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.578311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.578491] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.578588] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.578764] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.578863] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.578946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.579188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.579222] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.579382] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.579479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.579540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.579679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.579754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.579836] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1e3ea81-c174-445b-8347-b410d81bbc0d is going to be updated. [ 1276.601321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.601508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.601508] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.601720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.601848] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.602046] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.078714] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.581501] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.581801] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.581853] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.582111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.582208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.582306] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1277.610869] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.611184] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.611273] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.611496] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.611648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.620418] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1279.632184] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1279.632694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.632694] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.632836] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.632990] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.633115] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.633183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.633351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.633430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.633598] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.633598] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.136562] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.136767] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.136867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.137148] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.137390] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.137547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.137614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.137779] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.137878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.137969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.138154] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.138249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.138310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.139029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.139029] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.139029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.139029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.139029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.139029] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.139291] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.139291] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.641301] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba484ae0-86ee-48da-8cfe-e1829ca57af5: rpc.has_security_group_logging(os_id): False [ 1280.661442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.661634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.661727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.661970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.662109] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.662397] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.662937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.662937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.662937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.662937] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.663149] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.663281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.663345] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.663494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.663570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.663750] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.663843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.663903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.664091] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.664174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.664264] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1280.734766] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.734983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.734983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.735200] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.735353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.751633] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1281.074067] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.074067] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1282.769959] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1282.769959] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.435899] env[65455]: INFO networking_nsxv3.common.synchronization [req-f19f5a7e-3133-406d-b77b-48cbb68beda3 req-cd0e0149-2641-4018-9bfe-cda407f79419 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1283.436544] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGHEST for action security_group_members [ 1283.436912] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.437053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.437122] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.437315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.437475] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.437607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.437670] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.438352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.438352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.438352] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.940051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.940471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.940471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.940543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.940611] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.940813] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.940915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.940974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.941202] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.941281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.941371] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f is going to be updated. [ 1283.972341] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.972564] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.972616] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.972855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.972999] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.984632] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: IN_PROGRESS for 2s [ 1285.995417] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f in Status: SUCCESS [ 1285.995788] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f deletion is rescheduled due to dependency. [ 1285.995788] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.438266] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.438266] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1292.480130] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.480478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.480478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.480734] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.480986] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.481201] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.481344] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.481562] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.481706] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.481924] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.482054] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.482164] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.482272] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.482380] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.482481] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.482605] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.503653] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.503820] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.503940] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.504142] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-900" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.504454] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-d1e3ea81-c174-445b-8347-b410d81bbc0d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.504627] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.504744] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.505010] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.505153] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e3ea81-c174-445b-8347-b410d81bbc0d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.007976] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.008285] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.008360] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.008587] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.008737] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.009055] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.009269] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.009339] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.009593] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.009732] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.010028] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.010188] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.010305] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.010540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.010709] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.010849] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: d1e3ea81-c174-445b-8347-b410d81bbc0d is going to be updated. [ 1293.048348] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.048731] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.048787] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.049110] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.049272] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.049499] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.438971] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.439180] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.701741] env[65455]: INFO networking_nsxv3.common.synchronization [req-45c37870-ce72-4f95-ab78-3628c0bb1f29 req-f6db2dcf-2a4a-4044-ba6f-c520da1c2bb4 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1293.701992] env[65455]: INFO networking_nsxv3.common.synchronization [req-45c37870-ce72-4f95-ab78-3628c0bb1f29 req-f6db2dcf-2a4a-4044-ba6f-c520da1c2bb4 service nova] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1293.702057] env[65455]: INFO networking_nsxv3.common.synchronization [req-45c37870-ce72-4f95-ab78-3628c0bb1f29 req-f6db2dcf-2a4a-4044-ba6f-c520da1c2bb4 service nova] Enqueued Resource ID: d1e3ea81-c174-445b-8347-b410d81bbc0d with Priority: HIGHEST for action port [ 1293.702600] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_rules [ 1293.702741] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1293.702986] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e3ea81-c174-445b-8347-b410d81bbc0d with Priority: HIGHEST for action port [ 1293.703282] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.703647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.703647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.703647] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.703828] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.704567] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.704679] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.704738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.704899] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.705053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.705149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.705226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.705354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.705436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.705523] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.707588] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e3ea81-c174-445b-8347-b410d81bbc0d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.707656] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.707698] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.707838] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.707913] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e3ea81-c174-445b-8347-b410d81bbc0d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.210450] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.211508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.211689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.211689] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1e3ea81-c174-445b-8347-b410d81bbc0d with status ACTIVE [ 1294.211841] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.211938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.211995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.212231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.212323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.212484] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.212581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.212635] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.212789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.212865] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.213049] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.213144] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.213206] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.213421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.213459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.213522] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1e3ea81-c174-445b-8347-b410d81bbc0d is going to be updated. [ 1294.235294] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.235519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.235519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.235738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.235898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.236075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e3ea81-c174-445b-8347-b410d81bbc0d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.715424] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.220082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.220082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.220082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.220082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.220082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.220082] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1295.251025] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.251025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.251025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.251025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.251025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.259609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1297.271053] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1297.271053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.271053] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.271503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.271503] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.271503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.271641] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.271722] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.271804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.271890] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.271980] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.775088] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.775088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.775088] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.775365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.775614] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.775804] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.775942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.776244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.776420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.776600] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.776859] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.777058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.777196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.777448] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.777696] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.777871] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.777995] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.778257] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.778415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.778586] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.778761] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.281313] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba484ae0-86ee-48da-8cfe-e1829ca57af5: rpc.has_security_group_logging(os_id): False [ 1298.299274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.299497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.299497] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.299684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.299773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.300083] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.300197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.300266] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.300473] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.300558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.300752] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.300847] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.300910] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.301069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.301193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.301384] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.301480] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.301542] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.301684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.301759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.301845] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be updated. [ 1298.360744] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.360903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.360949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.361239] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.361384] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.377220] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: IN_PROGRESS for 2s [ 1298.703789] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.703949] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1300.394724] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 in Status: SUCCESS [ 1300.395134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.257711] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.257956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.257956] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.258192] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.258325] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.760351] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.263066] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.765573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1302.765573] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1303.509547] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.509745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.509745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.510012] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.524163] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1303.525128] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.525978] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1303.569669] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.569907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.569907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.570095] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.582073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.582820] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1303.582944] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1303.583017] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1303.623336] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.623504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.623541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.623747] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.625244] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.625426] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1303.702871] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.703157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.703157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.703297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.703615] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.703933] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1303.704934] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.705040] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.784784] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.785303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.785303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.785303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.785490] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.785803] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1303.785906] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'2d88d984-b158-405e-922b-bf70bddac6ef', '85d20cb9-f7bb-4040-85ef-bdc6cefbd02f', '9354847f-0991-42fd-9b0e-3a2865fde47c', 'ba484ae0-86ee-48da-8cfe-e1829ca57af5', 'dd5be889-3a5a-494d-988c-a8207be8c408', 'cd1120c8-14cf-47d8-87d2-dfaa63f749d7', 'd3665a01-cdc6-4c1e-8d6e-3891037fbac5', 'a0dd971a-8f02-4975-999f-f65b11c26fc9', 'd9b2cce2-94bc-4c70-8464-19808dc5cfe1', '34d06a71-fbe2-479a-842a-9891893495e3', '2391e1ec-f04f-463f-aaa0-77abb954955b', '2d8a958a-bd0c-4a44-825e-4612e0696bbe', '06a1d99f-1f74-4491-ba68-95d6af0beb2a', 'c376506d-a918-477c-96df-60ae10c0bcb8', 'f478263e-cdfa-466c-b468-3760ea97e6b8', '5dc78c59-d8d2-4264-8e48-80b9a24879c5', '5d835a6b-ad66-42cb-9c87-a0b00ea650f8', '96905b57-3285-43c8-99f7-2f66d28aafa1', 'cfc86584-6c08-4a39-8d62-18bde1a7dd9d', '0a198777-edb2-486c-96fc-27aa5daf59ad', 'c8ac4b88-966c-4479-95d3-80b154d92475', '8f01b182-5b01-4e49-8f70-13d804029019', 'e637b5c5-e399-481c-982c-2851963e7c48', 'f8950d72-cdfa-4b89-babf-49c50bce2b96', '2bcfe12f-28f7-472c-8e5a-1f4d45ae689c', '5c05eda9-c2f4-442b-be6e-f7bc8787f553', 'e805e5ac-07cc-4195-97d9-60139abf3cc5', 'c8cab38d-b4ee-4298-97b3-e8115ab313d7', '3313b461-f39b-4336-888c-410e1a4217c0', '50ff894b-9924-4f71-b210-20859560462d', 'a4a6023d-5c33-4db0-b5c2-37c37091322f', '10c4ff11-5e8b-4540-903a-abb548417d57', 'e3589c8d-1936-4d03-9343-f38b88e5f54f', 'edc405b2-4121-462f-8527-3f4dc420de69', 'de94ae8c-64b4-4119-bf51-89a5595f402a', '6ac3b58e-d195-4a17-8ba8-c2865a1a218d', 'daa747c9-bcaa-4016-b259-ce693108d0ee', 'a18e5b54-8a6d-4a7c-985e-7a6963e15109', '77e66828-af2a-4298-8b2d-caf16521cf90', '4e9d5580-b38c-4840-86f0-a6cc8d6dbd99', 'd70687e5-a5c2-4fcd-8aab-9c7e15c186ed', '039ffcce-1e26-4901-80d8-4b8e0ee79d6f', '26ffa055-bd42-40f4-8ddc-b843644594be', '92fa1390-194c-4487-a7c0-cfbabb347759', '38ce0832-87af-446e-9ffb-4cf08e497970', 'a0ddf7c7-f7d9-457a-834f-979355b01964', 'a86ef01d-dc8d-4d53-89c0-62ea8aeb7720', '07680d19-56f1-4d34-ab9f-26b0ad63d370'} {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1303.786028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1303.803709] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.803928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.803928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.804150] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.804236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.804349] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1303.804424] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1303.804525] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1303.886631] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.886856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.886856] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.887155] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.888334] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.888609] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1303.888689] env[65455]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65455) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1303.888763] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1303.888828] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1303.888906] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1303.888978] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 1303.889069] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGH for action security_group_rules [ 1303.889150] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGH for action security_group_rules [ 1303.889238] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGH for action security_group_rules [ 1303.889360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGH for action security_group_rules [ 1303.889360] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGH for action security_group_rules [ 1303.889452] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGH for action security_group_rules [ 1303.889452] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGH for action security_group_rules [ 1303.889528] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGH for action security_group_rules [ 1303.889589] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGH for action security_group_rules [ 1303.889649] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGH for action security_group_rules [ 1303.889710] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGH for action security_group_rules [ 1303.889826] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGH for action security_group_rules [ 1303.889826] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGH for action security_group_rules [ 1303.889917] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGH for action security_group_rules [ 1303.889954] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGH for action security_group_rules [ 1303.889991] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGH for action security_group_rules [ 1303.890076] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGH for action security_group_rules [ 1303.890136] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGH for action security_group_rules [ 1303.890200] env[65455]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGH for action security_group_rules [ 1303.890297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.818869] env[65455]: INFO networking_nsxv3.common.synchronization [req-e0532def-07dc-47ca-97cc-620b6a8d9176 req-1cc1ac87-74cc-4132-968a-36581b116018 tempest-AttachVolumeShelveTestJSON-295895509 tempest-AttachVolumeShelveTestJSON-295895509-project-member] Enqueued Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1306.819397] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fa1390-194c-4487-a7c0-cfbabb347759 with Priority: HIGHEST for action security_group_members [ 1306.819570] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d88d984-b158-405e-922b-bf70bddac6ef with Priority: HIGH for action security_group_rules [ 1306.819630] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9354847f-0991-42fd-9b0e-3a2865fde47c with Priority: HIGH for action security_group_rules [ 1306.819734] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGH for action security_group_rules [ 1306.819839] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGH for action security_group_rules [ 1306.819933] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a198777-edb2-486c-96fc-27aa5daf59ad with Priority: HIGH for action security_group_rules [ 1306.820059] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d with Priority: HIGH for action security_group_rules [ 1306.820121] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 with Priority: HIGH for action security_group_rules [ 1306.820207] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 with Priority: HIGH for action security_group_rules [ 1306.820298] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c376506d-a918-477c-96df-60ae10c0bcb8 with Priority: HIGH for action security_group_rules [ 1306.820387] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 with Priority: HIGH for action security_group_rules [ 1306.820476] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a with Priority: HIGH for action security_group_rules [ 1306.820571] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe with Priority: HIGH for action security_group_rules [ 1306.820656] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2391e1ec-f04f-463f-aaa0-77abb954955b with Priority: HIGH for action security_group_rules [ 1306.820739] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34d06a71-fbe2-479a-842a-9891893495e3 with Priority: HIGH for action security_group_rules [ 1306.820871] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 with Priority: HIGH for action security_group_rules [ 1306.821580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 with Priority: HIGH for action security_group_rules [ 1306.821580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 with Priority: HIGH for action security_group_rules [ 1306.821580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5be889-3a5a-494d-988c-a8207be8c408 with Priority: HIGH for action security_group_rules [ 1306.821580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f with Priority: HIGH for action security_group_rules [ 1306.821580] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGH for action security_group_rules [ 1306.822106] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-92fa1390-194c-4487-a7c0-cfbabb347759 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.822106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.822106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.822106] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.822289] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.822289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.822289] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.822445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.822538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.822610] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92fa1390-194c-4487-a7c0-cfbabb347759',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.823493] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d88d984-b158-405e-922b-bf70bddac6ef taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.824221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.824221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.824221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.824221] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d88d984-b158-405e-922b-bf70bddac6ef',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.824938] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9354847f-0991-42fd-9b0e-3a2865fde47c taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.825055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.825123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.825280] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.825351] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9354847f-0991-42fd-9b0e-3a2865fde47c',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.826024] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.826130] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.826193] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.826332] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.826405] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.827068] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.827174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.827235] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.827376] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.827448] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.828110] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a198777-edb2-486c-96fc-27aa5daf59ad taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.828245] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.828290] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.828955] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.828955] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a198777-edb2-486c-96fc-27aa5daf59ad',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.829318] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.829379] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.829458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.829602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.829676] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfc86584-6c08-4a39-8d62-18bde1a7dd9d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.830417] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96905b57-3285-43c8-99f7-2f66d28aafa1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.830494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.830535] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.830646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.830730] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96905b57-3285-43c8-99f7-2f66d28aafa1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.831421] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.831524] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.831575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.831725] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.831853] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d835a6b-ad66-42cb-9c87-a0b00ea650f8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.832611] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c376506d-a918-477c-96df-60ae10c0bcb8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.832720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.832778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.833369] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.833369] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c376506d-a918-477c-96df-60ae10c0bcb8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.834237] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.834237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.834237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.834237] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.834237] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dc78c59-d8d2-4264-8e48-80b9a24879c5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.834689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.834768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.834833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.834969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.835052] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06a1d99f-1f74-4491-ba68-95d6af0beb2a',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.835691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.835799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.835949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.835988] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.836444] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8a958a-bd0c-4a44-825e-4612e0696bbe',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.836790] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2391e1ec-f04f-463f-aaa0-77abb954955b taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.836895] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.836966] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.837263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.837263] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2391e1ec-f04f-463f-aaa0-77abb954955b',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.837829] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34d06a71-fbe2-479a-842a-9891893495e3 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.838162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.838162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.838162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.838267] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34d06a71-fbe2-479a-842a-9891893495e3',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.838933] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.838933] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.839242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.839242] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.839242] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9b2cce2-94bc-4c70-8464-19808dc5cfe1',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.839973] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.840581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.840581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.840581] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.840581] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd1120c8-14cf-47d8-87d2-dfaa63f749d7',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.841072] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0dd971a-8f02-4975-999f-f65b11c26fc9 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.841156] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.841236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.841421] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.841494] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0dd971a-8f02-4975-999f-f65b11c26fc9',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.842419] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5be889-3a5a-494d-988c-a8207be8c408 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.842419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.842419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.842571] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.842571] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5be889-3a5a-494d-988c-a8207be8c408',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.843834] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.843834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.843834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.844391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.844391] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85d20cb9-f7bb-4040-85ef-bdc6cefbd02f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.844568] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.844568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.844568] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.844980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.844980] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.347346] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.347510] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.347702] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.347888] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.348083] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.348190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.348946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.348946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.348946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.348946] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.348946] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.351456] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.351569] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.351634] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.351791] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.352100] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.352100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.352100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.352270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.352315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.352414] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.352503] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.358513] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.358618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.358881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.358881] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.433850] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.434092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.434905] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.435024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.435795] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.435921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.436594] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.436692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.448449] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.448603] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.449868] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.449980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.450690] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.450798] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.451579] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.451676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.453105] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.453219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.461351] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.461351] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.471922] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.472532] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.472644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.474183] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.474892] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.474892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.475616] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.476043] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.476149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.476878] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.477274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.477371] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.478095] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.478521] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.478618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.479528] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.479659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.479754] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.483036] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.483391] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.483760] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.483896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.483982] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.484196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.484282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.484368] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 is going to be updated. [ 1307.485393] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.485602] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.488321] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.488470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.497291] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.497405] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.525316] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1307.526660] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.526805] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dc78c59-d8d2-4264-8e48-80b9a24879c5 is going to be deleted. [ 1307.527843] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.528117] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.529858] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.530027] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.530100] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.530320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.530541] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.548865] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: IN_PROGRESS for 2s [ 1307.571097] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.571417] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8a958a-bd0c-4a44-825e-4612e0696bbe is going to be deleted. [ 1307.572796] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.573124] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.689509] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.689674] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0dd971a-8f02-4975-999f-f65b11c26fc9 is going to be deleted. [ 1307.690717] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.690983] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.694681] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.694851] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.713196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.713393] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06a1d99f-1f74-4491-ba68-95d6af0beb2a is going to be deleted. [ 1307.714363] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.714579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.723089] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.723089] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.737676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.737827] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96905b57-3285-43c8-99f7-2f66d28aafa1 is going to be deleted. [ 1307.738807] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.739048] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.751756] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.751970] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.759047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.759202] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd1120c8-14cf-47d8-87d2-dfaa63f749d7 is going to be deleted. [ 1307.760390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.760580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.787145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.787296] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be deleted. [ 1307.788249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.788494] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.825786] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.826872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.826872] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.826872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.832792] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.832912] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9354847f-0991-42fd-9b0e-3a2865fde47c is going to be deleted. [ 1307.833842] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.834069] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.864893] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.865951] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.867504] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.867504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.875727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.875867] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85d20cb9-f7bb-4040-85ef-bdc6cefbd02f is going to be deleted. [ 1307.876769] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.876986] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.917209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.918028] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34d06a71-fbe2-479a-842a-9891893495e3 is going to be deleted. [ 1307.918547] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.918688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.920196] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.920312] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.969132] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.969323] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.978649] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.978853] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfc86584-6c08-4a39-8d62-18bde1a7dd9d is going to be deleted. [ 1307.979923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.980162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.005486] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.005680] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.036677] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.036975] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9b2cce2-94bc-4c70-8464-19808dc5cfe1 is going to be deleted. [ 1308.038064] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.038298] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.092662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.092829] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a198777-edb2-486c-96fc-27aa5daf59ad is going to be deleted. [ 1308.093776] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.093993] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.095977] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.096092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.135802] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.136037] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.154969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.155165] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5be889-3a5a-494d-988c-a8207be8c408 is going to be deleted. [ 1308.156136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.156358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.165312] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.165523] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.233338] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.233823] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d88d984-b158-405e-922b-bf70bddac6ef is going to be deleted. [ 1308.234644] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.234885] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.270246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.270422] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2391e1ec-f04f-463f-aaa0-77abb954955b is going to be deleted. [ 1308.271411] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.271627] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.305790] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.306026] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.347964] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.348204] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.352033] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.352194] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c376506d-a918-477c-96df-60ae10c0bcb8 is going to be deleted. [ 1308.353169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.353400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.368517] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f478263e-cdfa-466c-b468-3760ea97e6b8: rpc.has_security_group_logging(os_id): False [ 1308.369700] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3665a01-cdc6-4c1e-8d6e-3891037fbac5: rpc.has_security_group_logging(os_id): False [ 1308.432105] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.432250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.433667] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.433855] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.434825] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.434925] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.435659] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.435764] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.451705] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.451913] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d835a6b-ad66-42cb-9c87-a0b00ea650f8 is going to be deleted. [ 1308.452968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.453335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.453452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.453592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dc78c59-d8d2-4264-8e48-80b9a24879c5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.453759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.453944] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.454024] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.454143] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8a958a-bd0c-4a44-825e-4612e0696bbe" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.454774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.454953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.455047] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.455195] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0dd971a-8f02-4975-999f-f65b11c26fc9" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.455327] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.455475] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.455551] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.455773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06a1d99f-1f74-4491-ba68-95d6af0beb2a" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.455929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.456090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.456165] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.456275] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96905b57-3285-43c8-99f7-2f66d28aafa1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.456399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.456579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.456624] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.456844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd1120c8-14cf-47d8-87d2-dfaa63f749d7" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.457030] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.457158] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.457302] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.457418] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.457549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.457691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.457765] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.457952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9354847f-0991-42fd-9b0e-3a2865fde47c" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.458096] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.458238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.458311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.458426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85d20cb9-f7bb-4040-85ef-bdc6cefbd02f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.458549] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.458687] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.458760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.458870] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34d06a71-fbe2-479a-842a-9891893495e3" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.458992] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.459145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.459221] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.459360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfc86584-6c08-4a39-8d62-18bde1a7dd9d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.459458] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.459623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.459688] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.459815] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9b2cce2-94bc-4c70-8464-19808dc5cfe1" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.459969] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.460121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.460198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.460488] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a198777-edb2-486c-96fc-27aa5daf59ad" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.460618] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.460759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.460833] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.460941] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5be889-3a5a-494d-988c-a8207be8c408" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.461081] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.461216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.461362] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.461471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2391e1ec-f04f-463f-aaa0-77abb954955b" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.461597] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.461739] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.530974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.530974] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.530974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.530974] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.531347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.531347] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.531347] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 is going to be updated. [ 1308.532527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.532734] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.574374] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.574538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.596402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.596733] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.596839] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.598271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.598271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.598271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.598271] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1308.598503] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.598710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.598797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.598915] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d88d984-b158-405e-922b-bf70bddac6ef" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.599090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.599285] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.599374] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.599487] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c376506d-a918-477c-96df-60ae10c0bcb8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.614491] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.614650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.614745] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.614954] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.615142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.615214] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d835a6b-ad66-42cb-9c87-a0b00ea650f8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.712625] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.712834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.712834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.713219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.713459] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.718430] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.718560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.718630] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.718822] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.718958] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.732095] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1308.732816] env[65455]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1308.733208] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: IN_PROGRESS for 2s [ 1309.559872] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92fa1390-194c-4487-a7c0-cfbabb347759 in Status: SUCCESS [ 1309.560353] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92fa1390-194c-4487-a7c0-cfbabb347759 deletion is rescheduled due to dependency. [ 1309.560353] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92fa1390-194c-4487-a7c0-cfbabb347759" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.072305] env[65455]: INFO networking_nsxv3.common.synchronization [req-e8196590-9e99-46d0-bcbf-f6734b1552b8 req-db011c8b-bd12-4def-a219-3ab95508b4dd tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1310.072915] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1310.073237] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.073358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.073424] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.073642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.074233] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.074233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.074233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.074233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.074233] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.074485] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.576384] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.747035] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1310.747035] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.747386] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: SUCCESS [ 1310.747961] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.078430] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.581673] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.582087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.582087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.582087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.582209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.582345] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be updated. [ 1311.612789] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.613052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.613052] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.613260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.613404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.622424] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1313.634842] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1313.635216] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.074653] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.074653] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1316.062325] env[65455]: INFO networking_nsxv3.common.synchronization [req-2682a11e-9ea8-41bb-8705-c5486e5189c2 req-bd024240-7d49-4d66-a135-125221220094 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1316.062959] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1316.063304] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.063498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.063589] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.063858] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.063942] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.065039] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.065238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.065436] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.065536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.065639] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.570499] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.570499] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.570499] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.571250] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.571250] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1316.601805] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.601950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.602123] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.602255] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.602401] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.613230] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1317.461705] env[65455]: INFO networking_nsxv3.common.synchronization [req-342a724f-bd6e-42dd-a886-8d6f013c6049 req-800a0873-3d0b-4249-ba9c-ab5867c1bfc2 tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1317.462346] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26ffa055-bd42-40f4-8ddc-b843644594be with Priority: HIGHEST for action security_group_members [ 1317.462699] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-26ffa055-bd42-40f4-8ddc-b843644594be taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.462841] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.462908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.463114] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.463268] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.463364] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.463442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.463606] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.463668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.463753] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26ffa055-bd42-40f4-8ddc-b843644594be',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.966114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.966420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.966420] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.966553] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.989707] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.989979] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.990113] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.990169] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.990365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.990447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.990535] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be is going to be updated. [ 1318.017603] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.017786] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.017826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.018018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.018175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.026545] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: IN_PROGRESS for 2s [ 1318.623368] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1318.623553] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 deletion is rescheduled due to dependency. [ 1318.623704] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.036892] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26ffa055-bd42-40f4-8ddc-b843644594be in Status: SUCCESS [ 1320.037231] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26ffa055-bd42-40f4-8ddc-b843644594be deletion is rescheduled due to dependency. [ 1320.037231] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26ffa055-bd42-40f4-8ddc-b843644594be" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.975649] env[65455]: INFO networking_nsxv3.common.synchronization [None req-aadcb6e4-fe34-4de0-9de0-1a7fe8f3fcce tempest-AttachInterfacesTestJSON-1967881836 tempest-AttachInterfacesTestJSON-1967881836-project-member] Enqueued Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1321.976228] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 with Priority: HIGHEST for action security_group_members [ 1321.976542] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba484ae0-86ee-48da-8cfe-e1829ca57af5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.976693] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.976805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.977111] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.977348] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.977481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.977572] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.977719] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.977805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.977896] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba484ae0-86ee-48da-8cfe-e1829ca57af5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.479881] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.480147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.480147] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.480534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.480534] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.480907] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.480907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.480907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.480907] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.481092] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.481092] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba484ae0-86ee-48da-8cfe-e1829ca57af5 is going to be deleted. [ 1322.518405] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.518713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.518713] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.518787] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.518896] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.518951] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba484ae0-86ee-48da-8cfe-e1829ca57af5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.719274] env[65455]: INFO networking_nsxv3.common.synchronization [req-d9a434eb-8c88-4872-9031-0d122536dc00 req-a04f3f27-c798-4eb1-995b-b4b361e8ece7 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1323.719781] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1323.720633] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.721136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.721136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.721136] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.721354] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.721354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.721552] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.721604] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.721691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.721808] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.074220] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.074417] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.074540] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.074810] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.075077] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.075237] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.075351] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.075589] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.075726] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.075934] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.076054] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.076164] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.076272] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.076384] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1324.076489] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.076690] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.098571] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.098725] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1324.098867] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.099067] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.099389] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.099561] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.099681] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.100028] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.100175] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88a506d-c89b-4f45-a4bb-a6fa6010a75f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.224295] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.224560] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.224711] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.224957] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.225075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.225302] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.225419] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.225492] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.225691] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.225773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.225868] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1324.259080] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.259282] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.259325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.259562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.259710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.269269] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1324.602566] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.602901] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.603042] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.603326] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.603476] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.603633] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port f88a506d-c89b-4f45-a4bb-a6fa6010a75f not found, creating... [ 1324.603921] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.604094] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.604213] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.604434] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.604639] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.604843] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.605063] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.605121] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.605338] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.605472] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.605610] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: f88a506d-c89b-4f45-a4bb-a6fa6010a75f is going to be created. [ 1324.625888] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.626092] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.626220] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.626478] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.626739] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.626967] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.132799] env[65455]: INFO networking_nsxv3.common.synchronization [req-2eb488c2-9aa1-4952-b367-aa2ba694adb1 req-22fde097-3607-44e6-8427-c537fccb14cd tempest-AttachVolumeNegativeTest-847532219 tempest-AttachVolumeNegativeTest-847532219-project-member] Enqueued Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1325.133789] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3589c8d-1936-4d03-9343-f38b88e5f54f with Priority: HIGHEST for action security_group_members [ 1325.134311] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3589c8d-1936-4d03-9343-f38b88e5f54f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.134878] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.135071] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.135404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.135647] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.137017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.137017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.137017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.137017] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.137017] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3589c8d-1936-4d03-9343-f38b88e5f54f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.364039] env[65455]: INFO networking_nsxv3.common.synchronization [req-d9a434eb-8c88-4872-9031-0d122536dc00 req-e4ab0717-dcd2-455e-8655-89c14f706f6d service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 1325.364236] env[65455]: INFO networking_nsxv3.common.synchronization [req-d9a434eb-8c88-4872-9031-0d122536dc00 req-e4ab0717-dcd2-455e-8655-89c14f706f6d service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1325.364393] env[65455]: INFO networking_nsxv3.common.synchronization [req-d9a434eb-8c88-4872-9031-0d122536dc00 req-e4ab0717-dcd2-455e-8655-89c14f706f6d service nova] Enqueued Resource ID: f88a506d-c89b-4f45-a4bb-a6fa6010a75f with Priority: HIGHEST for action port [ 1325.365186] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 1325.365515] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1325.365515] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88a506d-c89b-4f45-a4bb-a6fa6010a75f with Priority: HIGHEST for action port [ 1325.366741] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.366741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.366741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.366741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.366741] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.368358] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.368477] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.368738] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.368844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.370139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.370139] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.370139] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88a506d-c89b-4f45-a4bb-a6fa6010a75f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.639274] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.639455] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.639519] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.639727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.661352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.661689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.661814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.661892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.662137] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.662224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.662312] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f is going to be updated. [ 1325.688654] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.688823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.688882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.689070] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.689209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.697447] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: IN_PROGRESS for 2s [ 1325.869028] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.869174] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.871766] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f88a506d-c89b-4f45-a4bb-a6fa6010a75f with status ACTIVE [ 1325.872053] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.872225] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.872317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.872675] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.872771] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.872980] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.873133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.873175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.873303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.873380] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.874060] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.874227] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.874301] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.874498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.874731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.874866] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f88a506d-c89b-4f45-a4bb-a6fa6010a75f is going to be updated. [ 1325.898172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.898389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.898389] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.898592] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.898728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.898979] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f88a506d-c89b-4f45-a4bb-a6fa6010a75f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.278043] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1326.278396] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 deletion is rescheduled due to dependency. [ 1326.278396] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.278486] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.278706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.278889] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.279016] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.279082] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.279236] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.279318] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.279411] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.782128] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.285285] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.706800] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3589c8d-1936-4d03-9343-f38b88e5f54f in Status: SUCCESS [ 1327.706997] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3589c8d-1936-4d03-9343-f38b88e5f54f deletion is rescheduled due to dependency. [ 1327.706997] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3589c8d-1936-4d03-9343-f38b88e5f54f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.787808] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.788055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.788055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.788270] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.788361] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.788465] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1327.814844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.815084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.815084] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.815313] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.815485] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.824079] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1329.836949] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.836949] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.836949] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.837642] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.837642] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.339859] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.366113] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.366113] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1330.490193] env[65455]: INFO networking_nsxv3.common.synchronization [req-64bac9b1-f75f-4299-afea-4f8966821a48 req-9c71019b-0a9d-4d5a-a1b4-2f12d9d6a973 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1330.490472] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 with Priority: HIGHEST for action security_group_members [ 1330.490852] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.491127] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.491223] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.491428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.492050] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.492119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.492182] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.492336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.492423] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.492549] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3665a01-cdc6-4c1e-8d6e-3891037fbac5',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.844060] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f478263e-cdfa-466c-b468-3760ea97e6b8: rpc.has_security_group_logging(os_id): False [ 1330.863324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.863530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.863530] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.863753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.863860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.864122] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.864224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.864336] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.864427] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.864540] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.864594] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1330.924597] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.924766] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.924831] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.925061] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.925212] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.939762] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1330.994580] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.994864] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.994968] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.995226] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.995329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.995544] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.995669] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.995728] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.995913] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.996162] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.996263] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 is going to be updated. [ 1331.029082] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.029360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.029360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.029700] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.029860] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.040873] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: IN_PROGRESS for 2s [ 1332.956685] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1332.957163] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.053206] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 in Status: SUCCESS [ 1333.053287] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3665a01-cdc6-4c1e-8d6e-3891037fbac5 deletion is rescheduled due to dependency. [ 1333.053354] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3665a01-cdc6-4c1e-8d6e-3891037fbac5" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.491769] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.492088] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.119254] env[65455]: INFO networking_nsxv3.common.synchronization [req-a3d9eaec-fee7-4ddd-96ec-a27af6845a37 req-36c5807b-399e-4c67-97e6-cb670869da34 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1340.119954] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1340.120691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.120772] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.120867] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.121087] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.121254] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.121360] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.121426] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.121636] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.121763] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.121823] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.390277] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.390544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.390544] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.390759] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.391089] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.391256] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.391375] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.391609] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.391767] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.391974] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.392100] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1340.392209] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1340.392314] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1340.392421] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.392665] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1340.392665] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1340.414016] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1340.414238] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1340.414379] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1340.414557] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.414875] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-a2ec5590-201d-4c2d-bb85-67970207869d taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.415062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.415184] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.415519] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.415661] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ec5590-201d-4c2d-bb85-67970207869d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.624451] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.624614] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.624684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.624903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.647755] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.648018] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.648153] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.648224] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.648434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.648527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.648629] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be updated. [ 1340.679595] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.679817] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.679894] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.680179] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.680381] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.692200] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1340.917816] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.918036] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.918165] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.918455] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.918602] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.918790] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port a2ec5590-201d-4c2d-bb85-67970207869d not found, creating... [ 1340.919031] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.919193] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.919309] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.919537] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.919779] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.920020] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.920180] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.920295] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.920497] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.920629] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.920774] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: a2ec5590-201d-4c2d-bb85-67970207869d is going to be created. [ 1340.942599] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.942918] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.943046] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.943723] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.944015] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.944203] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.660675] env[65455]: INFO networking_nsxv3.common.synchronization [req-a3d9eaec-fee7-4ddd-96ec-a27af6845a37 req-d4939659-8f9a-4a60-85a6-07f7bb7e5951 service nova] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_rules [ 1341.660951] env[65455]: INFO networking_nsxv3.common.synchronization [req-a3d9eaec-fee7-4ddd-96ec-a27af6845a37 req-d4939659-8f9a-4a60-85a6-07f7bb7e5951 service nova] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1341.661015] env[65455]: INFO networking_nsxv3.common.synchronization [req-a3d9eaec-fee7-4ddd-96ec-a27af6845a37 req-d4939659-8f9a-4a60-85a6-07f7bb7e5951 service nova] Enqueued Resource ID: a2ec5590-201d-4c2d-bb85-67970207869d with Priority: HIGHEST for action port [ 1341.661485] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_rules [ 1341.661706] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1341.661834] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ec5590-201d-4c2d-bb85-67970207869d with Priority: HIGHEST for action port [ 1341.662126] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.662249] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.662315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.662502] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.662691] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.663433] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.663544] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.663716] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ec5590-201d-4c2d-bb85-67970207869d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.663814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.663901] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.664045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.664123] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ec5590-201d-4c2d-bb85-67970207869d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.167948] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.167948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.171267] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2ec5590-201d-4c2d-bb85-67970207869d with status ACTIVE [ 1342.171473] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.171594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.171778] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.171889] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.171977] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.172172] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.172274] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.172335] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.172579] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.172724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.172876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.172972] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.173041] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.173188] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.173263] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.173347] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2ec5590-201d-4c2d-bb85-67970207869d is going to be updated. [ 1342.201131] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.201281] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.201355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.201646] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.201790] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.201953] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.702029] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1342.702468] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f deletion is rescheduled due to dependency. [ 1342.702468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.702562] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.702738] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.702928] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.703065] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.703133] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.703295] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.703415] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.703525] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.205996] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.708870] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.212058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.212058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.212297] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.212390] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.212462] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.212610] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be updated. [ 1344.249114] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.249308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.249349] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.249558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.249727] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.258501] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1346.270882] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1346.271264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.271264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.271536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.271830] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.271980] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.272119] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.272329] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.272439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.272538] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.272684] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.662940] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.663138] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1346.774796] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.775055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.775055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.775243] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.775442] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.775577] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.775648] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.775826] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.775923] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.776060] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.776207] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.776310] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.776399] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.776543] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.776682] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.776775] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.776835] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.776971] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.777063] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.777172] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.777263] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.279468] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 039ffcce-1e26-4901-80d8-4b8e0ee79d6f: rpc.has_security_group_logging(os_id): False [ 1347.297993] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.298178] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.298219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.298434] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.298522] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.298745] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.298846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.298900] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.299073] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.299167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.299372] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.299468] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.299527] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.299681] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.299770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.299947] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.300074] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.300149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.300314] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.300403] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.300543] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be updated. [ 1347.374211] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.374495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.374495] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.374741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.374873] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.386678] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1349.402681] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1349.403120] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.819495] env[65455]: INFO networking_nsxv3.common.synchronization [req-eb36fd50-4e7f-4711-9600-fabe544e0540 req-a6417525-d3bb-4209-a773-d28c04066a84 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1349.819701] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f with Priority: HIGHEST for action security_group_members [ 1349.820101] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.820308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.820442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.820797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.820797] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.820921] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.820964] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.821099] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.821186] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.821276] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('039ffcce-1e26-4901-80d8-4b8e0ee79d6f',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.862644] env[65455]: INFO networking_nsxv3.common.synchronization [req-eb36fd50-4e7f-4711-9600-fabe544e0540 req-a6417525-d3bb-4209-a773-d28c04066a84 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: a2ec5590-201d-4c2d-bb85-67970207869d with Priority: HIGHEST for action port [ 1349.862644] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ec5590-201d-4c2d-bb85-67970207869d with Priority: HIGHEST for action port [ 1349.862904] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ec5590-201d-4c2d-bb85-67970207869d taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.863265] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.863443] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.864809] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.864809] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ec5590-201d-4c2d-bb85-67970207869d',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.323234] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.323430] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.323532] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.323824] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.323967] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.324249] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.324392] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.324479] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.324685] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.324793] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.324912] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f is going to be updated. [ 1350.353324] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.353518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.353518] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.353773] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.353938] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.363737] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: IN_PROGRESS for 2s [ 1350.366108] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2ec5590-201d-4c2d-bb85-67970207869d with status ACTIVE [ 1350.366391] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.366594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.366668] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.366898] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.366965] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.367161] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.367264] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.367325] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.367478] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.367558] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.367739] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.367832] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.367892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.368258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.368258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.368258] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2ec5590-201d-4c2d-bb85-67970207869d is going to be updated. [ 1350.394320] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.394320] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.394609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.394609] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.394737] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.394872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ec5590-201d-4c2d-bb85-67970207869d" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.373825] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f in Status: SUCCESS [ 1352.374141] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 039ffcce-1e26-4901-80d8-4b8e0ee79d6f deletion is rescheduled due to dependency. [ 1352.374190] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-039ffcce-1e26-4901-80d8-4b8e0ee79d6f" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.863158] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.863526] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.864471] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.864814] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.865452] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.865801] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.867097] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.867420] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.868395] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.868678] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.464571] env[65455]: INFO networking_nsxv3.common.synchronization [req-738ac171-7287-4c77-bc0e-55fbef98bce4 req-ec6a11ce-fc00-4bc8-a3d2-fd8d4bd37a24 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1375.464910] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1375.465399] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.465556] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.465633] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.465823] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.466154] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.466154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.466154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.466317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.466416] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.466510] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.749045] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock network-872 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.749045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.749045] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.749287] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.749371] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.749539] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.749657] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.749903] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.750065] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.750277] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1375.750391] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1375.750501] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1375.750610] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1375.750719] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1375.750822] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1375.751335] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1375.770172] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1375.770339] env[65455]: DEBUG dogpile.cache.region [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1375.770476] env[65455]: DEBUG dogpile.lock [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1375.770651] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "network-872" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.770955] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock port-fe910460-05a3-4191-8fbb-32d9d372a433 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.771140] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.771263] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.771588] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.771727] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe910460-05a3-4191-8fbb-32d9d372a433',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.968318] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.275062] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.275062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.275062] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.275346] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.275456] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.275610] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Segment Port fe910460-05a3-4191-8fbb-32d9d372a433 not found, creating... [ 1376.275872] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.276040] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.276159] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.276373] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.276532] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.276769] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.276921] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.277043] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.277254] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.277384] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.278476] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Resource: SegmentPort with ID: fe910460-05a3-4191-8fbb-32d9d372a433 is going to be created. [ 1376.299689] env[65455]: DEBUG networking_nsxv3.common.locking [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.299912] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.300042] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.300325] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.300553] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.300842] env[65455]: DEBUG oslo_concurrency.lockutils [None req-a38d7185-30df-4d12-bc52-881651ea8804 None None] Releasing lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.472186] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.974691] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.975134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.975134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.975256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.975256] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.975351] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be updated. [ 1376.986152] env[65455]: INFO networking_nsxv3.common.synchronization [req-738ac171-7287-4c77-bc0e-55fbef98bce4 req-b072b8b5-56ac-4858-a14e-8cc612c47ba4 service nova] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1376.986342] env[65455]: INFO networking_nsxv3.common.synchronization [req-738ac171-7287-4c77-bc0e-55fbef98bce4 req-b072b8b5-56ac-4858-a14e-8cc612c47ba4 service nova] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1376.986481] env[65455]: INFO networking_nsxv3.common.synchronization [req-738ac171-7287-4c77-bc0e-55fbef98bce4 req-b072b8b5-56ac-4858-a14e-8cc612c47ba4 service nova] Enqueued Resource ID: fe910460-05a3-4191-8fbb-32d9d372a433 with Priority: HIGHEST for action port [ 1376.986707] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_rules [ 1376.986834] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1376.986928] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe910460-05a3-4191-8fbb-32d9d372a433 with Priority: HIGHEST for action port [ 1376.987478] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.987607] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.987662] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.987883] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.987937] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.988751] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.988872] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.989058] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe910460-05a3-4191-8fbb-32d9d372a433 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.989183] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.989219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.989385] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.989461] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe910460-05a3-4191-8fbb-32d9d372a433',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.004097] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.004308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.004308] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.004456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.004594] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.016100] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1377.491610] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.491760] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.491928] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe910460-05a3-4191-8fbb-32d9d372a433 with status ACTIVE [ 1377.492232] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.492375] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.492504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.492653] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.492742] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.492922] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.493055] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.493152] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.493355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.493440] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.493630] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.493774] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.493814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.493978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.494075] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.494168] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe910460-05a3-4191-8fbb-32d9d372a433 is going to be updated. [ 1377.517634] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.517797] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.517844] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.518062] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.518196] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.518352] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe910460-05a3-4191-8fbb-32d9d372a433" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.028274] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1379.028692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.028692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.028960] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.029188] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.029328] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.029400] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.029580] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.029665] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.029772] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.531992] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.034486] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.536835] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.537134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.537286] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.537706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.537846] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.538027] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be updated. [ 1380.566976] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.566976] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.567238] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.567276] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.567451] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.578065] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1381.987734] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.988164] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1382.588758] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1382.589023] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.589134] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.589315] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.589508] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.589652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.589724] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.589827] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.589904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.589990] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.590118] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.093167] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.595141] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edc405b2-4121-462f-8527-3f4dc420de69: rpc.has_security_group_logging(os_id): False [ 1383.614587] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.614820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.614820] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.615043] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.635718] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.636051] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.636177] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.636246] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.636450] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.636529] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.636619] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be updated. [ 1383.693519] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.693710] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.693759] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.693928] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.694086] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.707898] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1385.726353] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1385.726740] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.988613] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.989147] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.990397] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.990669] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.991942] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.992392] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.993606] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.993892] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.059354] env[65455]: INFO networking_nsxv3.common.synchronization [req-2929407a-f9b0-4e12-b641-625e4121d696 req-f400dea5-d1b3-4ba5-9ba8-0ab26e90cf3e tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1405.059889] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1405.060231] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.060355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.060684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.060684] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.060844] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.060904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.060952] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.061157] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.061241] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.061362] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.564242] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.564498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.564498] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.564692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.564813] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.565030] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.565132] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.565198] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.565365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.565447] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.565533] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1405.593932] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.594175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.594175] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.594358] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.594559] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.602675] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1407.613876] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1407.614271] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 deletion is rescheduled due to dependency. [ 1407.614271] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.061315] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.061658] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.280425] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb1cc9b5-cd09-4bdd-89eb-87d3d5889602 req-b1822282-c240-4ee6-a8d1-d7a4589c4dd7 tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1414.281021] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1414.281337] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.281463] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.281531] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.281720] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.281876] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.281975] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.282059] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.282197] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.282279] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.282368] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.581589] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.581795] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.581983] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.582528] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.582748] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.582917] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.583108] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.583407] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.583654] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.583913] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1414.584061] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] NeedRegenerationException {{(pid=65455) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1414.584215] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] no value, waiting for create lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1414.584361] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] value creation lock acquired {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1414.584491] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] No value present for key: 'zone-id' {{(pid=65455) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1414.584663] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Calling creation function for not-yet-present value {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1414.584859] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1414.606198] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1414.606401] env[65455]: DEBUG dogpile.cache.region [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65455) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1414.606613] env[65455]: DEBUG dogpile.lock [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Released creation lock {{(pid=65455) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1414.606827] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "network-298" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.607233] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock port-2316ce4f-39fd-4105-92de-af1e1709a6b0 taken with stack trace [, , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.607462] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.608049] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.608049] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.608223] env[65455]: DEBUG networking_nsxv3.api.rpc [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2316ce4f-39fd-4105-92de-af1e1709a6b0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.784797] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.785045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.785045] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.785259] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.785365] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.785602] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.785706] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.785770] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.785931] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.786015] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.786105] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1414.814209] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.814428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.814428] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.814623] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.814840] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.825237] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1415.111188] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.111405] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.111475] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.111764] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.111909] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.112078] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Segment Port 2316ce4f-39fd-4105-92de-af1e1709a6b0 not found, creating... [ 1415.112350] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.112523] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.112647] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.112874] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.113080] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.113324] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.113511] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.113660] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.113873] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.114014] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.114159] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Resource: SegmentPort with ID: 2316ce4f-39fd-4105-92de-af1e1709a6b0 is going to be created. [ 1415.142555] env[65455]: DEBUG networking_nsxv3.common.locking [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.142796] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.142902] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.143203] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.143466] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.143713] env[65455]: DEBUG oslo_concurrency.lockutils [None req-2fe34ac6-31da-4ead-9970-40ff1ebd745f None None] Releasing lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.831967] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb1cc9b5-cd09-4bdd-89eb-87d3d5889602 req-1859ab91-0348-4839-85c3-0af49b9ec10c service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 1415.832246] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb1cc9b5-cd09-4bdd-89eb-87d3d5889602 req-1859ab91-0348-4839-85c3-0af49b9ec10c service nova] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1415.832308] env[65455]: INFO networking_nsxv3.common.synchronization [req-bb1cc9b5-cd09-4bdd-89eb-87d3d5889602 req-1859ab91-0348-4839-85c3-0af49b9ec10c service nova] Enqueued Resource ID: 2316ce4f-39fd-4105-92de-af1e1709a6b0 with Priority: HIGHEST for action port [ 1415.832853] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_rules [ 1415.833019] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1415.833592] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2316ce4f-39fd-4105-92de-af1e1709a6b0 with Priority: HIGHEST for action port [ 1415.833884] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.836845] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.836845] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.836845] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock port-2316ce4f-39fd-4105-92de-af1e1709a6b0 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.836845] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.836845] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2316ce4f-39fd-4105-92de-af1e1709a6b0',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.338388] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.338617] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.339201] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2316ce4f-39fd-4105-92de-af1e1709a6b0 with status ACTIVE [ 1416.339392] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.339514] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.339575] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.339799] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.339947] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.340091] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.340149] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.340219] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.340402] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.340501] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.340689] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.340782] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.340834] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.340978] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.341058] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.341149] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2316ce4f-39fd-4105-92de-af1e1709a6b0 is going to be updated. [ 1416.362996] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.363260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.363260] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.363561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.363731] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.363948] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2316ce4f-39fd-4105-92de-af1e1709a6b0" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.835846] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1416.836317] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 deletion is rescheduled due to dependency. [ 1416.836317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.836317] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.836517] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.836695] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.836830] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.836942] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.837108] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.837220] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.837318] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.339867] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.842989] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.345227] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.345404] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.345456] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.345661] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.345753] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.345853] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1418.374570] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.374570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.374570] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.374892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.374892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.383204] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1420.394798] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1420.395167] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.395208] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.395452] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.395657] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.395748] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.395789] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.395929] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.396025] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.396116] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.396208] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.835098] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.835297] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1420.898820] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.401498] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f478263e-cdfa-466c-b468-3760ea97e6b8: rpc.has_security_group_logging(os_id): False [ 1421.419255] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.419481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.419481] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.419676] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.419768] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.420039] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.420145] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.420209] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.420368] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.420471] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.420565] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1421.476084] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.476311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.476311] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.476504] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.476650] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.488478] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1423.501102] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1423.501536] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.836518] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.836882] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.837820] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.838227] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.839025] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.839394] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.840536] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.840938] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.842072] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.842659] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.285642] env[65455]: INFO networking_nsxv3.common.synchronization [req-6ff200b7-4025-4185-ada6-fe6f11074b91 req-1c93a82d-65b1-4e4f-8266-41c93fb7287d tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1446.286209] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1446.286520] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.286692] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.286756] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.286892] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.287052] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.287154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.287213] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.287355] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.287445] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.287600] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1446.789948] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.292374] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.795950] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.795950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.795950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.795950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.795950] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.795950] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be updated. [ 1447.825338] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.825563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.825563] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.825741] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.825882] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.835888] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1449.847162] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1449.847561] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.287111] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.287465] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.288600] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.289055] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.291375] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.291719] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.521717] env[65455]: INFO networking_nsxv3.common.synchronization [req-5d3e7208-833c-4f78-8a15-b58c9c38f23a req-18fd9e5f-1567-4c49-8238-4f71ce441cf1 tempest-ServerActionsTestOtherA-932304416 tempest-ServerActionsTestOtherA-932304416-project-member] Enqueued Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1461.522248] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edc405b2-4121-462f-8527-3f4dc420de69 with Priority: HIGHEST for action security_group_members [ 1461.522573] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-edc405b2-4121-462f-8527-3f4dc420de69 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.522729] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.522829] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.523442] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.523636] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.523751] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.523814] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.524018] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.524142] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.524265] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edc405b2-4121-462f-8527-3f4dc420de69',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.027470] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.027470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.027470] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.027805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.027805] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.027963] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.028068] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.028154] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.028303] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.028372] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.028462] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 is going to be updated. [ 1462.056677] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.056919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.056919] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.057121] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.057267] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.066704] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: IN_PROGRESS for 2s [ 1464.080548] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edc405b2-4121-462f-8527-3f4dc420de69 in Status: SUCCESS [ 1464.080797] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edc405b2-4121-462f-8527-3f4dc420de69 deletion is rescheduled due to dependency. [ 1464.080908] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edc405b2-4121-462f-8527-3f4dc420de69" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.523657] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.523906] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.524422] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.524422] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.525653] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.526082] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.038805] env[65455]: INFO networking_nsxv3.common.synchronization [req-797278b5-be3a-4e74-919d-2bdec80f62ab req-d81cbdd7-d617-4ec3-a764-53581e96b9bf tempest-ServerActionsTestJSON-2006150203 tempest-ServerActionsTestJSON-2006150203-project-member] Enqueued Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1477.039422] env[65455]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f478263e-cdfa-466c-b468-3760ea97e6b8 with Priority: HIGHEST for action security_group_members [ 1477.040135] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock member-f478263e-cdfa-466c-b468-3760ea97e6b8 taken with stack trace [, , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.040135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.040135] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.040342] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.040489] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.040590] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.040652] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.040810] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.040903] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.040998] env[65455]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f478263e-cdfa-466c-b468-3760ea97e6b8',) {} {{(pid=65455) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1477.543383] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.543935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.543935] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.544090] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.544131] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.544441] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.544591] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.544689] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.544904] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.545044] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.545170] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 is going to be updated. [ 1477.571725] env[65455]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65455) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.571932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.571932] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.572110] env[65455]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.572258] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.582656] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: IN_PROGRESS for 2s [ 1479.594019] env[65455]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f478263e-cdfa-466c-b468-3760ea97e6b8 in Status: SUCCESS [ 1479.594439] env[65455]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f478263e-cdfa-466c-b468-3760ea97e6b8 deletion is rescheduled due to dependency. [ 1479.594439] env[65455]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f478263e-cdfa-466c-b468-3760ea97e6b8" {{(pid=65455) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.040510] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.040903] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.042016] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.042454] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.043666] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.044124] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.045502] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.045897] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.306855] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1498.307375] env[65455]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-67173052-5f09-4d85-b70b-ae6bfbf2ad1d None None] NSXv3 Agent Agent loop - iteration:4 started [ 1502.047144] env[65455]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.047553] env[65455]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0